Helsinki-NLP / OPUS
The Open Parallel Corpus
☆67Updated last week
Alternatives and similar repositories for OPUS:
Users that are interested in OPUS are comparing it to the libraries listed below
- Repository accompanying "An Open Dataset and Model for Language Identification" (Burchell et al., 2023)☆70Updated 11 months ago
- Translation demonstrator☆32Updated 4 years ago
- ☆72Updated last week
- Open language modeling toolkit based on PyTorch☆106Updated this week
- Seed Machine Translation Data☆31Updated 4 months ago
- OpusFilter - Parallel corpus processing toolkit☆104Updated last week
- NTREX -- News Test References for MT Evaluation☆81Updated 9 months ago
- Bicleaner fork that uses neural networks☆39Updated 8 months ago
- OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.☆51Updated 2 months ago
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆156Updated 9 months ago
- Library and command line utility to do approximate string matching of a source against a bitext index and get matched source and target.☆50Updated 3 months ago
- A tool that locates, downloads, and extracts machine translation corpora☆154Updated this week
- Efficient teacher-student models and scripts to make them☆50Updated last year
- Extracts plain text, language identification and more metadata from WARC records☆21Updated last month
- Efficient Low-Memory Aligner☆143Updated 2 months ago
- MAchine Translation Evaluation Online (MATEO)☆20Updated 3 weeks ago
- Multilingual sentence alignment using sentence embeddings☆113Updated 4 months ago
- MAMMOTH: MAssively Multilingual Modular Open Translation @ Helsinki☆22Updated last month
- Curriculum training☆17Updated 3 weeks ago
- Open information and community for machine translation☆74Updated last week
- An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…☆22Updated 3 years ago
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆271Updated 2 months ago
- Tool to fix bitexts and tag near-duplicates for removal☆30Updated last month
- Bitextor generates translation memories from multilingual websites☆292Updated 4 months ago
- A sentence segmentation library with wide language support optimized for speed and utility.☆60Updated 7 months ago
- Universal Romanizer that can convert any unicode script to roman (latin) script☆189Updated 8 months ago
- Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023☆100Updated 11 months ago
- OPUS-CAT is a collection of software which make it possible to OPUS-MT neural machine translation models in professional translation. OPU…☆75Updated 2 months ago
- MorphyNet: a Large Multilingual Database of Derivational and Inflectional Morphology (+morpheme segmentation)☆42Updated 2 years ago
- The FLORES+ Machine Translation Benchmark☆101Updated 4 months ago