Helsinki-NLP / OPUS-MT-trainLinks
Training open neural machine translation models
☆389Updated 9 months ago
Alternatives and similar repositories for OPUS-MT-train
Users that are interested in OPUS-MT-train are comparing it to the libraries listed below
Sorting:
- Open neural machine translation models and web services☆755Updated last month
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆287Updated 2 months ago
- ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.☆590Updated 2 years ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆256Updated 3 years ago
- Neural Machine Translation (NMT) tutorial. Data preprocessing, model training, evaluation, and deployment.☆173Updated last week
- Multilingual sentence alignment using sentence embeddings☆133Updated last year
- Facebook Low Resource (FLoRes) MT Benchmark☆757Updated 2 years ago
- This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…☆162Updated last year
- NeuSpell: A Neural Spelling Correction Toolkit☆702Updated 2 years ago
- Bitextor generates translation memories from multilingual websites☆299Updated last year
- Open language modeling toolkit based on PyTorch☆161Updated last week
- A neural word aligner based on multilingual BERT☆363Updated 3 years ago
- Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.☆255Updated 3 years ago
- OpusFilter - Parallel corpus processing toolkit☆113Updated 2 weeks ago
- CoVoST: A Large-Scale Multilingual Speech-To-Text Translation Corpus (CC0 Licensed)☆393Updated 4 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆385Updated 2 years ago
- Library for translating between 200 languages. Built on 🤗 transformers.☆495Updated last year
- A Neural Framework for MT Evaluation☆697Updated 4 months ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆159Updated last year
- Punctuation Restoration using Transformer Models for High-and Low-Resource Languages☆226Updated last year
- Easy to use, state-of-the-art Neural Machine Translation for 100+ languages☆1,241Updated 2 years ago
- ☆529Updated last year
- Improved Sentence Alignment in Linear Time and Space☆186Updated 2 years ago
- ☆57Updated 3 years ago
- ☆1,295Updated 3 years ago
- Text2Text Language Modeling Toolkit☆305Updated 11 months ago
- Open information and community for machine translation☆80Updated last month
- A sentence segmenter that actually works!☆304Updated 5 years ago
- The pipeline for the OSCAR corpus☆174Updated last month
- A tool that locates, downloads, and extracts machine translation corpora☆159Updated 3 months ago