Alternatives and similar repositories for GEMBA:

Users that are interested in GEMBA are comparing it to the libraries listed below

• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆105Updated last month
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆71Updated last year
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆100Updated last year
• lukemelas / mtob
  ☆34Updated 10 months ago
• biomedical-translation-corpora / corpora
  Parallel corpora for the biomedical domain
  ☆48Updated 9 months ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆93Updated last year
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆72Updated 2 years ago
• neulab / contextual-mt
  A repository with the code related to experiments around context-aware machine translation
  ☆49Updated 2 years ago
• google / wmt-mqm-human-evaluation
  ☆84Updated 7 months ago
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated last year
• ZurichNLP / ContraDecode
  The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Deco…
  ☆34Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆123Updated 8 months ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆83Updated 10 months ago
• ZurichNLP / coverage-contrastive-conditioning
  Data and code accompanying the paper "As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive…
  ☆22Updated 2 years ago
• spraakbanken / multiged-2023
  ☆15Updated 2 years ago
• marzenakrp / LiteraryTranslation
  ☆23Updated last year
• wmt-conference / wmt22-news-systems
  ☆20Updated 2 years ago
• marzenakrp / demetr
  Repository for DEMETR: Diagnosing Evaluation Metrics for Translation
  ☆15Updated 2 years ago
• EleanorJiang / BlonDe
  Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …
  ☆78Updated last year
• lisasiyu / Cross-Align
  EMNLP2022 "Cross-Align: Modeling Deep Cross-lingual Interactions for Word Alignment"
  ☆18Updated 2 years ago
• NLP2CT / UniTE
  ☆11Updated 2 years ago
• Yale-LILY / QMSum
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆120Updated last year
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• mahfuzibnalam / terminology_evaluation
  ☆21Updated 2 years ago
• cambridgeltl / composable-sft
  A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.
  ☆71Updated 8 months ago
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆61Updated last month
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• microsoft / Multilingual-Evaluation-of-Generative-AI-MEGA
  Code for Multilingual Eval of Generative AI paper published at EMNLP 2023
  ☆68Updated last year
• tmramalho / finetune-mbart
  How to finetune mbart using fairseq
  ☆24Updated 4 years ago
• wmt-conference / wmt-format-tools
  Tools for formatting WMT hypothesis and test sets in XML
  ☆25Updated last week