Alternatives and similar repositories for OPUS-MT-train

Users that are interested in OPUS-MT-train are comparing it to the libraries listed below

• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆748Updated 3 weeks ago
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆287Updated last month
• eole-nlp / eole
  Open language modeling toolkit based on PyTorch
  ☆159Updated last week
• ymoslem / OpenNMT-Tutorial
  Neural Machine Translation (NMT) tutorial. Data preprocessing, model training, evaluation, and deployment.
  ☆172Updated last year
• xhluca / dl-translate
  Library for translating between 200 languages. Built on 🤗 transformers.
  ☆495Updated last year
• facebookresearch / flores
  Facebook Low Resource (FLoRes) MT Benchmark
  ☆757Updated 2 years ago
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆700Updated 2 years ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆385Updated 2 years ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆590Updated 2 years ago
• google-research / byt5
  ☆530Updated last year
• nlp-uoregon / trankit
  Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing
  ☆774Updated 4 months ago
• facebookresearch / covost
  CoVoST: A Large-Scale Multilingual Speech-To-Text Translation Corpus (CC0 Licensed)
  ☆392Updated 4 years ago
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆113Updated last month
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆298Updated last year
• zafercavdar / fasttext-langdetect
  80x faster and 95% accurate language identification with Fasttext
  ☆163Updated last year
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆131Updated last year
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆160Updated last year
• pluiez / NLLB-inference
  ☆57Updated 3 years ago
• Unbabel / COMET
  A Neural Framework for MT Evaluation
  ☆687Updated 3 months ago
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆255Updated 3 years ago
• google-research-datasets / C4_200M-synthetic-dataset-for-grammatical-error-correction
  This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…
  ☆161Updated last year
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆361Updated 3 years ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆109Updated last year
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆174Updated last month
• google-research / multilingual-t5
  ☆1,291Updated 2 years ago
• artitw / text2text
  Text2Text Language Modeling Toolkit
  ☆304Updated 10 months ago
• UKPLab / EasyNMT
  Easy to use, state-of-the-art Neural Machine Translation for 100+ languages
  ☆1,242Updated last year
• thompsonb / vecalign
  Improved Sentence Alignment in Linear Time and Space
  ☆186Updated 2 years ago
• mjpost / sacrebleu
  Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
  ☆1,201Updated this week
• xashru / punctuation-restoration
  Punctuation Restoration using Transformer Models for High-and Low-Resource Languages
  ☆223Updated last year