Alternatives and similar repositories for GEMBA

Users that are interested in GEMBA are comparing it to the libraries listed below

• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆110Updated 4 months ago
• EleanorJiang / BlonDe
  Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …
  ☆77Updated last year
• google / wmt-mqm-human-evaluation
  ☆88Updated 9 months ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆103Updated last year
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆73Updated last year
• neulab / contextual-mt
  A repository with the code related to experiments around context-aware machine translation
  ☆50Updated 3 years ago
• ZurichNLP / ContraDecode
  The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Deco…
  ☆35Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated 2 years ago
• m-popovic / chrF
  a tool for calcualting character n-gram F score
  ☆73Updated 2 years ago
• ZurichNLP / nmtscore
  A library of translation-based text similarity measures
  ☆25Updated last year
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆127Updated 10 months ago
• Yale-LILY / QMSum
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆129Updated last year
• roeeaharoni / unsupervised-domain-clusters
  Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".
  ☆58Updated 4 years ago
• katherinethai / par3
  ☆28Updated 7 months ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• NJUNLP / MMT-LLM
  ☆34Updated 2 years ago
• THUNLP-MT / Mask-Align
  Code for our paper "Mask-Align: Self-Supervised Neural Word Alignment" in ACL 2021
  ☆61Updated 4 years ago
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 4 months ago
• google-research / url-nlp
  ☆215Updated 2 weeks ago
• MicrosoftTranslator / NTREX
  NTREX -- News Test References for MT Evaluation
  ☆84Updated last year
• lukemelas / mtob
  ☆36Updated last year
• shuo-git / VecConstNMT
  ☆25Updated 2 years ago
• hsing-wang / Awesome-LLM-MT
  ☆242Updated last year
• marzenakrp / LiteraryTranslation
  ☆23Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated 3 weeks ago
• mahfuzibnalam / terminology_evaluation
  ☆21Updated 3 years ago
• openlanguagedata / flores
  The FLORES+ Machine Translation Benchmark
  ☆106Updated 8 months ago
• wmt-conference / wmt-format-tools
  Tools for formatting WMT hypothesis and test sets in XML
  ☆27Updated 2 months ago
• ZurichNLP / coverage-contrastive-conditioning
  Data and code accompanying the paper "As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive…
  ☆22Updated 2 years ago
• AIPHES / emnlp19-moverscore
  MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance
  ☆208Updated last year