Helsinki-NLP / Tatoeba-Challenge
☆813Updated 4 months ago
Alternatives and similar repositories for Tatoeba-Challenge:
Users that are interested in Tatoeba-Challenge are comparing it to the libraries listed below
- Fast Neural Machine Translation in C++☆1,275Updated last year
- Open neural machine translation models and web services☆640Updated last month
- Crawl BookCorpus☆814Updated last year
- Facebook Low Resource (FLoRes) MT Benchmark☆717Updated last year
- Training open neural machine translation models☆346Updated 5 months ago
- ☆1,259Updated 2 years ago
- Bitextor generates translation memories from multilingual websites☆293Updated 2 months ago
- Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)☆353Updated last year
- Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.☆152Updated 7 months ago
- A neural word aligner based on multilingual BERT☆336Updated 2 years ago
- XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 ty…☆636Updated 2 years ago
- Simple, fast unsupervised word aligner☆742Updated 2 years ago
- Improved Sentence Alignment in Linear Time and Space☆163Updated last year
- Python port of Moses tokenizer, truecaser and normalizer☆490Updated 7 months ago
- A tool that locates, downloads, and extracts machine translation corpora☆149Updated 7 months ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,091Updated last week
- Tools and Modeling Code for the MASSIVE dataset☆542Updated 2 years ago
- Fast BPE☆659Updated 7 months ago
- Easy to use, state-of-the-art Neural Machine Translation for 100+ languages☆1,195Updated last year
- BLEURT is a metric for Natural Language Generation based on transfer learning.☆711Updated last year
- 📃Language Model based sentences scoring library☆307Updated 2 years ago
- Minimalist NMT for educational purposes☆684Updated 11 months ago
- A single model that parses Universal Dependencies across 75 languages. Given a sentence, jointly predicts part-of-speech tags, morphology…☆221Updated 2 years ago
- ☆489Updated 11 months ago
- ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.☆571Updated last year
- Text2Text Language Modeling Toolkit☆292Updated this week
- Neural Machine Translation (NMT) tutorial. Data preprocessing, model training, evaluation, and deployment.☆155Updated 9 months ago
- A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…☆263Updated this week
- Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing☆743Updated 3 months ago
- Fast Neural Machine Translation in C++ - development repository☆258Updated 2 months ago