Alternatives and similar repositories for flores

Users that are interested in flores are comparing it to the libraries listed below

• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆748Updated 2 years ago
• mjpost / sacrebleu
  Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
  ☆1,164Updated 4 months ago
• google-research / multilingual-t5
  ☆1,280Updated 2 years ago
• Unbabel / COMET
  A Neural Framework for MT Evaluation
  ☆642Updated this week
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆373Updated last year
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆354Updated 3 years ago
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆282Updated 6 months ago
• google-research / xtreme
  XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 ty…
  ☆644Updated 2 years ago
• google-research / byt5
  ☆515Updated last year
• google-research-datasets / tydiqa
  TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …
  ☆310Updated 5 years ago
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆156Updated 2 months ago
• google-research-datasets / paws
  This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, an…
  ☆560Updated 3 years ago
• joeynmt / joeynmt
  Minimalist NMT for educational purposes
  ☆699Updated last year
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆496Updated last year
• glample / fastBPE
  Fast BPE
  ☆670Updated last year
• facebookresearch / vizseq
  An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)
  ☆445Updated last month
• gentaiscool / code-switching-papers
  A curated list of research papers and resources on code-switching
  ☆321Updated 7 months ago
• neulab / compare-mt
  A tool for holistic analysis of language generations systems
  ☆471Updated 3 years ago
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆371Updated 4 months ago
• prajdabre / yanmtt
  Yet Another Neural Machine Translation Toolkit
  ☆179Updated 5 months ago
• chrisjbryant / errant
  ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.
  ☆450Updated last year
• facebookresearch / covost
  CoVoST: A Large-Scale Multilingual Speech-To-Text Translation Corpus (CC0 Licensed)
  ☆386Updated 3 years ago
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆756Updated 3 years ago
• grammarly / gector
  Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagg…
  ☆930Updated last year
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,022Updated 2 years ago
• bert-nmt / bert-nmt
  ☆362Updated 2 years ago
• Unbabel / OpenKiwi
  Open-Source Machine Translation Quality Estimation in PyTorch
  ☆232Updated 3 years ago
• Helsinki-NLP / Opus-MT
  Open neural machine translation models and web services
  ☆713Updated last month
• thompsonb / vecalign
  Improved Sentence Alignment in Linear Time and Space
  ☆180Updated 2 years ago
• facebookresearch / LASER
  Language-Agnostic SEntence Representations
  ☆3,649Updated last year