Alternatives and similar repositories for flores

Users that are interested in flores are comparing it to the libraries listed below

• mjpost / sacrebleu
  Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
  ☆1,168Updated 5 months ago
• google-research / bleurt
  BLEURT is a metric for Natural Language Generation based on transfer learning.
  ☆752Updated 2 years ago
• google-research / xtreme
  XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 ty…
  ☆647Updated 2 years ago
• Unbabel / COMET
  A Neural Framework for MT Evaluation
  ☆649Updated 3 weeks ago
• facebookresearch / stopes
  A library for preparing data for machine translation research (monolingual preprocessing, bitext mining, etc.) built by the FAIR NLLB te…
  ☆282Updated 7 months ago
• cisnlp / simalign
  Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)
  ☆375Updated last year
• google-research / multilingual-t5
  ☆1,281Updated 2 years ago
• joeynmt / joeynmt
  Minimalist NMT for educational purposes
  ☆702Updated last year
• neulab / awesome-align
  A neural word aligner based on multilingual BERT
  ☆355Updated 3 years ago
• Helsinki-NLP / OPUS-MT-train
  Training open neural machine translation models
  ☆373Updated 5 months ago
• google-research-datasets / tydiqa
  TyDi QA contains 200k human-annotated question-answer pairs in 11 Typologically Diverse languages, written without seeing the answer and …
  ☆312Updated 5 years ago
• thammegowda / mtdata
  A tool that locates, downloads, and extracts machine translation corpora
  ☆156Updated 3 months ago
• prajdabre / yanmtt
  Yet Another Neural Machine Translation Toolkit
  ☆179Updated 5 months ago
• google-research / byt5
  ☆517Updated last year
• hplt-project / sacremoses
  Python port of Moses tokenizer, truecaser and normalizer
  ☆496Updated last year
• grammarly / gector
  Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagg…
  ☆933Updated last year
• clab / fast_align
  Simple, fast unsupervised word aligner
  ☆756Updated 3 years ago
• GEM-benchmark / NL-Augmenter
  NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations
  ☆788Updated last year
• neulab / compare-mt
  A tool for holistic analysis of language generations systems
  ☆471Updated 3 years ago
• facebookresearch / vizseq
  An Analysis Toolkit for Natural Language Generation (Translation, Captioning, Summarization, etc.)
  ☆445Updated 2 months ago
• glample / fastBPE
  Fast BPE
  ☆674Updated last year
• chrisjbryant / errant
  ERRor ANnotation Toolkit: Automatically extract and classify grammatical errors in parallel original and corrected sentences.
  ☆451Updated last year
• facebookresearch / XNLI
  Evaluating Cross-lingual Sentence Representations
  ☆457Updated 4 years ago
• facebookresearch / cc_net
  Tools to download and cleanup Common Crawl data
  ☆1,026Updated 2 years ago
• awslabs / mlm-scoring
  Python library & examples for Masked Language Model Scoring (ACL 2020)
  ☆345Updated 2 years ago
• google-research-datasets / paws
  This dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, an…
  ☆560Updated 3 years ago
• facebookresearch / anli
  Adversarial Natural Language Inference Benchmark
  ☆397Updated 3 years ago
• soskek / bookcorpus
  Crawl BookCorpus
  ☆842Updated 2 years ago
• Unbabel / OpenKiwi
  Open-Source Machine Translation Quality Estimation in PyTorch
  ☆232Updated 3 years ago
• facebookresearch / KILT
  Library for Knowledge Intensive Language Tasks
  ☆954Updated 3 years ago