Alternatives and similar repositories for GEMBA

Users that are interested in GEMBA are comparing it to the libraries listed below

• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆119Updated last month
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆106Updated last year
• google / wmt-mqm-human-evaluation
  ☆96Updated last month
• ZurichNLP / ContraDecode
  The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Deco…
  ☆36Updated 2 months ago
• EleanorJiang / BlonDe
  Official implementations for (1) BlonDe: An Automatic Evaluation Metric for Document-level Machine Translation and (2) Discourse Centric …
  ☆79Updated 2 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆95Updated 2 years ago
• bigscience-workshop / multilingual-modeling
  BLOOM+1: Adapting BLOOM model to support a new unseen language
  ☆74Updated last year
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated 2 weeks ago
• Yale-LILY / QMSum
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆139Updated 2 years ago
• dapascual / K2T
  ☆71Updated 4 years ago
• neulab / contextual-mt
  A repository with the code related to experiments around context-aware machine translation
  ☆51Updated last month
• google-research / url-nlp
  ☆220Updated 3 months ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆133Updated last year
• roeeaharoni / unsupervised-domain-clusters
  Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".
  ☆58Updated 5 years ago
• ThomasScialom / QuestEval
  ☆102Updated last year
• nyu-mll / quality
  ☆141Updated 10 months ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• maszhongming / UniEval
  Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
  ☆213Updated last year
• yxuansu / Contrastive_Search_Is_What_You_Need
  [TMLR'23] Contrastive Search Is What You Need For Neural Text Generation
  ☆121Updated 2 years ago
• deep-spin / hallucinations-in-nmt
  ☆20Updated last year
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆81Updated last year
• THUNLP-MT / Mask-Align
  Code for our paper "Mask-Align: Self-Supervised Neural Word Alignment" in ACL 2021
  ☆61Updated 4 years ago
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 8 months ago
• NJUNLP / MMT-LLM
  ☆35Updated 2 years ago
• hsing-wang / Awesome-LLM-MT
  ☆250Updated last year
• shuo-git / VecConstNMT
  ☆25Updated 3 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• vipulraheja / iterater
  Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)
  ☆80Updated 2 years ago
• yizhongw / Tk-Instruct
  Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.
  ☆182Updated 3 years ago