Alternatives and similar repositories for metametrics

Users that are interested in metametrics are comparing it to the libraries listed below

• lukemelas / mtob
  ☆36Updated last year
• mbzuai-nlp / bactrian-x
  A Multilingual Replicable Instruction-Following Model
  ☆94Updated 2 years ago
• SeaEval / SeaEval
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆25Updated 4 months ago
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆33Updated last year
• deep-spin / hallucinations-in-nmt
  ☆20Updated last year
• nayeon7lee / FactualityPrompt
  ☆87Updated 2 years ago
• cisnlp / Glot500
  Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023
  ☆103Updated last year
• ZurichNLP / multilingual-instruction-tuning
  Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"
  ☆25Updated last month
• ZurichNLP / ContraDecode
  The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Deco…
  ☆35Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• ndaheim / faithful-dialogue
  ☆24Updated 2 years ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated 11 months ago
• nlp-uoregon / mlmm-evaluation
  Multilingual Large Language Models Evaluation Benchmark
  ☆127Updated 10 months ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• Betswish / MIRAGE
  Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/
  ☆24Updated 4 months ago
• neulab / knn-transformers
  PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an…
  ☆275Updated 2 years ago
• google-research / mt-metrics-eval
  Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.
  ☆110Updated 4 months ago
• eladsegal / strategyqa
  The official code of TACL 2021, "Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies".
  ☆75Updated 2 years ago
• hitz-zentroa / lm-contamination
  The LM Contamination Index is a manually created database of contamination evidences for LMs.
  ☆78Updated last year
• KwanWaiChung / M4LE
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆23Updated 11 months ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 4 months ago
• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆31Updated 2 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• mprompting / xlmrprompt
  ☆11Updated 3 years ago
• gsarti / pecore
  Materials for "Quantifying the Plausibility of Context Reliance in Neural Machine Translation" at ICLR'24 🐑 🐑
  ☆15Updated last year
• BatsResearch / crosslingual-test-time-scaling
  Crosslingual Reasoning through Test-Time Scaling
  ☆18Updated 2 months ago
• mt-upc / transformer-contributions-nmt
  ☆17Updated 2 years ago
• SimengSun / alpaca_farm_lora
  ☆22Updated last year
• qinyiwei / InfoBench
  ☆55Updated 10 months ago