Helsinki-NLP / OPUS-MT-trainLinks
Training open neural machine translation models
☆380Updated 7 months ago
Alternatives and similar repositories for OPUS-MT-train
Users that are interested in OPUS-MT-train are comparing it to the libraries listed below
Sorting:
- Open neural machine translation models and web services☆737Updated 4 months ago
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆283Updated 2 weeks ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆255Updated 2 years ago
- Facebook Low Resource (FLoRes) MT Benchmark☆753Updated last year
- Open language modeling toolkit based on PyTorch☆152Updated 2 weeks ago
- OpusFilter - Parallel corpus processing toolkit☆110Updated 3 weeks ago
- NeuSpell: A Neural Spelling Correction Toolkit☆697Updated 2 years ago
- Multilingual sentence alignment using sentence embeddings☆127Updated 11 months ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆159Updated last year
- ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.☆587Updated 2 years ago
- Bitextor generates translation memories from multilingual websites☆296Updated 11 months ago
- Neural Machine Translation (NMT) tutorial. Data preprocessing, model training, evaluation, and deployment.☆170Updated last year
- Improved Sentence Alignment in Linear Time and Space☆184Updated 2 years ago
- 80x faster and 95% accurate language identification with Fasttext☆161Updated last year
- This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…☆161Updated last year
- The FLORES+ Machine Translation Benchmark☆108Updated 11 months ago
- Library for translating between 200 languages. Built on 🤗 transformers.☆494Updated last year
- ☆57Updated 3 years ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆379Updated last year
- A neural word aligner based on multilingual BERT☆358Updated 3 years ago
- Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.☆256Updated 2 years ago
- State-of-the-art LLM-based translation models.☆558Updated 6 months ago
- CoVoST: A Large-Scale Multilingual Speech-To-Text Translation Corpus (CC0 Licensed)☆389Updated 4 years ago
- ☆524Updated last year
- Punctuation Restoration using Transformer Models for High-and Low-Resource Languages☆223Updated last year
- ☆49Updated last year
- Universal Romanizer that can convert any unicode script to roman (latin) script☆226Updated last year
- The pipeline for the OSCAR corpus☆173Updated last year
- LASER multilingual sentence embeddings as a pip package☆225Updated 2 years ago
- A sentence segmenter that actually works!☆305Updated 5 years ago