Alternatives and similar repositories for OPUS-MT-train

Users that are interested in OPUS-MT-train are comparing it to the libraries listed below

• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆699Updated last week
• abelriboulot / onnxt5
  Summarization, translation, sentiment-analysis, text-generation and more at blazing speed using a T5 version implemented in ONNX.
  ☆254Updated 2 years ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆157Updated last year
• bfsujason / bertalign
  Multilingual sentence alignment using sentence embeddings
  ☆120Updated 7 months ago
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆280Updated 5 months ago
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆155Updated 3 weeks ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆363Updated last year
• bitextor / bitextor
  Bitextor generates translation memories from multilingual websites
  ☆293Updated 7 months ago
• eole-nlp / eole
  Open language modeling toolkit based on PyTorch
  ☆129Updated last month
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆350Updated 3 years ago
• neuspell / neuspell
  NeuSpell: A Neural Spelling Correction Toolkit
  ☆695Updated last year
• thompsonb / vecalign
  Improved Sentence Alignment in Linear Time and Space
  ☆174Updated 2 years ago
• google-research / byt5
  ☆510Updated last year
• TharinduDR / TransQuest
  Transformer based translation quality estimation
  ☆111Updated last year
• Helsinki-NLP / OpusFilter
  OpusFilter - Parallel corpus processing toolkit
  ☆104Updated this week
• facebookresearch / flores
  Facebook Low Resource (FLoRes) MT Benchmark
  ☆740Updated last year
• marian-nmt / marian
  Fast Neural Machine Translation in C++
  ☆1,338Updated last year
• google-research-datasets / C4_200M-synthetic-dataset-for-grammatical-error-correction
  This dataset contains synthetic training data for grammatical error correction. The corpus is generated by corrupting clean sentences fro…
  ☆161Updated 9 months ago
• bojone / labse
  Language-agnostic BERT Sentence Embedding (LaBSE)
  ☆151Updated 4 years ago
• Ki6an / fastT5
  ⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
  ☆579Updated 2 years ago
• oscar-project / ungoliant
  The pipeline for the OSCAR corpus
  ☆169Updated last year
• marian-nmt / marian-dev
  Fast Neural Machine Translation in C++ - development repository
  ☆273Updated 8 months ago
• Unbabel / OpenKiwi
  Open-Source Machine Translation Quality Estimation in PyTorch
  ☆231Updated 3 years ago
• xhluca / dl-translate
  Library for translating between 200 languages. Built on 🤗 transformers.
  ☆484Updated 9 months ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,016Updated 2 years ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆105Updated 7 months ago
• ZNLP / BigTranslate
  BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
  ☆227Updated last year
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆495Updated last year
• mediacloud / sentence-splitter
  Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.
  ☆248Updated 2 years ago
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆433Updated 2 years ago