Alternatives and similar repositories for metametrics

Users that are interested in metametrics are comparing it to the libraries listed below

• deep-spin / hallucinations-in-nmt
  ☆20Updated last year
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆25Updated 5 months ago
• lukemelas / mtob
  ☆37Updated last year
• shadowkiller33 / ParaScore
  ☆29Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆81Updated 3 weeks ago
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆77Updated 2 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• nayeon7lee / FactualityPrompt
  ☆87Updated 2 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• ZurichNLP / ContraDecode
  The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Deco…
  ☆35Updated last year
• yixinL7 / SumLLM
  Repo for "On Learning to Summarize with Large Language Models as References"
  ☆43Updated 2 years ago
• shuo-git / VecConstNMT
  ☆25Updated 2 years ago
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 5 months ago
• qinyiwei / InfoBench
  ☆55Updated 11 months ago
• jinlanfu / Polyglot_Prompt
  Code and dataset for Polyglot Prompting: Multilingual Multitask Prompt Training.
  ☆18Updated 2 years ago
• ndaheim / faithful-dialogue
  ☆24Updated 2 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• gsarti / pecore
  Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑
  ☆15Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated 11 months ago
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆33Updated last year
• roeeaharoni / unsupervised-domain-clusters
  Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".
  ☆58Updated 4 years ago
• McGill-NLP / FaithDial
  ☆51Updated 2 years ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆115Updated 2 years ago
• BinWang28 / EvalRank-Embedding-Evaluation
  ACL 2022: Just Rank: Rethinking Evaluation with Word and Sentence Similarities
  ☆35Updated 2 years ago
• SALT-NLP / mic
  Data and code for the paper "The Moral Integrity Corpus: A Benchmark for Ethical Dialogue Systems"
  ☆20Updated 2 years ago
• Leezekun / dialogic
  [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"
  ☆35Updated 2 years ago
• yrf1 / LLM-MassiveMulticultureNormsKnowledge-NCLB
  ☆18Updated 5 months ago
• NJUNLP / MMT-LLM
  ☆34Updated 2 years ago