Alternatives and similar repositories for flores

Users that are interested in flores are comparing it to the libraries listed below

• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆733Updated last year
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆276Updated 4 months ago
• google-research / xtreme
  XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 ty…
  ☆644Updated 2 years ago
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆348Updated 3 years ago
• mjpost / sacrebleu
  Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
  ☆1,142Updated 2 months ago
• google-research-datasets / tydiqa
  TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …
  ☆307Updated 5 years ago
• google-research / byt5
  ☆507Updated last year
• Unbabel / COMET
  A Neural Framework for MT Evaluation
  ☆603Updated 2 weeks ago
• microsoft / fastseq
  An efficient implementation of the popular sequence models for text generation, summarization, and translation tasks. https://arxiv.org/p…
  ☆433Updated 2 years ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆104Updated 6 months ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆361Updated last year
• facebookresearch / vizseq
  An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)
  ☆445Updated 2 months ago
• google-research / multilingual-t5
  ☆1,275Updated 2 years ago
• joeynmt / joeynmt
  Minimalist NMT for educational purposes
  ☆694Updated last year
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆155Updated last week
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆494Updated last year
• GEM-benchmark / NL-Augmenter
  NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations
  ☆786Updated last year
• bert-nmt / bert-nmt
  ☆362Updated 2 years ago
• neulab / compare-mt
  A tool for holistic analysis of language generations systems
  ☆468Updated 3 years ago
• microsoft / fastformers
  FastFormers - highly efficient transformer models for NLU
  ☆705Updated 2 months ago
• glample / fastBPE
  Fast BPE
  ☆671Updated 11 months ago
• facebookresearch / KILT
  Library for Knowledge Intensive Language Tasks
  ☆944Updated 3 years ago
• prajdabre / yanmtt
  Yet Another Neural Machine Translation Toolkit
  ☆178Updated 2 months ago
• bitextor / bicleaner
  Bicleaner is a parallel corpus classifier/cleaner that aims at detecting noisy sentence pairs in a parallel corpus.
  ☆157Updated 11 months ago
• facebookresearch / LASER
  Language-Agnostic SEntence Representations
  ☆3,640Updated last year
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆754Updated 2 years ago
• nyu-mll / jiant
  jiant is an nlp toolkit
  ☆1,667Updated last year
• google-research-datasets / paws
  This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, an…
  ☆557Updated 3 years ago
• google-research / url-nlp
  ☆211Updated 3 months ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,010Updated 2 years ago