Helsinki-NLP / OPUS-MT-train
Training open neural machine translation models
☆357Updated last month
Alternatives and similar repositories for OPUS-MT-train:
Users that are interested in OPUS-MT-train are comparing it to the libraries listed below
- Open neural machine translation models and web services☆681Updated 4 months ago
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆272Updated 3 months ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆157Updated 10 months ago
- Facebook Low Resource (FLoRes) MT Benchmark☆727Updated last year
- Open language modeling toolkit based on PyTorch☆114Updated this week
- ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.☆578Updated 2 years ago
- This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…☆161Updated 7 months ago
- ☆503Updated last year
- Universal Romanizer that can convert any unicode script to roman (latin) script☆192Updated 9 months ago
- A neural word aligner based on multilingual BERT☆346Updated 3 years ago
- The pipeline for the OSCAR corpus☆168Updated last year
- NeuSpell: A Neural Spelling Correction Toolkit☆692Updated last year
- 80x faster and 95% accurate language identification with Fasttext☆152Updated last year
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆361Updated last year
- 💬 Language Identification with Support for More Than 2000 Labels -- EMNLP 2023☆127Updated 4 months ago
- A Neural Framework for MT Evaluation☆580Updated 2 weeks ago
- Improved Sentence Alignment in Linear Time and Space☆169Updated 2 years ago
- Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.☆253Updated 2 years ago
- Training scripts for Argos Translate☆131Updated 5 months ago
- Bitextor generates translation memories from multilingual websites☆292Updated 5 months ago
- Crosslingual Generalization through Multitask Finetuning☆531Updated 7 months ago
- A model that predicts the punctuation of English, Italian, French and German texts.☆80Updated 2 years ago
- Language-agnostic BERT Sentence Embedding (LaBSE)☆151Updated 4 years ago
- The FLORES+ Machine Translation Benchmark☆102Updated 5 months ago
- Translation demonstrator☆33Updated 4 years ago
- OpusFilter - Parallel corpus processing toolkit☆104Updated last month
- Simple, fast unsupervised word aligner☆751Updated 2 years ago
- CoVoST: A Large-Scale Multilingual Speech-To-Text Translation Corpus (CC0 Licensed)☆376Updated 3 years ago
- Multilingual sentence alignment using sentence embeddings☆116Updated 5 months ago
- BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages☆222Updated last year