Alternatives and similar repositories for MetricEval

Users that are interested in MetricEval are comparing it to the libraries listed below

• prometheus-eval / scaling-evaluation-compute
  Repository for "Scaling Evaluation-time Compute with Reasoning Models as Process Evaluators"
  ☆12Updated 8 months ago
• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆31Updated last year
• naver-ai / ALMoST
  ☆24Updated 2 years ago
• Tiiiger / templm
  Code release for "TempLM: Distilling Language Models into Template-Based Generators"
  ☆14Updated 3 years ago
• kaistAI / KtrlF
  [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"
  ☆23Updated last year
• SLAB-NLP / Multi-Prompt-LLM-Evaluation
  State of What Art? A Call for Multi-Prompt LLM Evaluation
  ☆15Updated last year
• kaistAI / GAP
  [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization
  ☆29Updated last year
• kaistAI / How-Well-Do-LLMs-Truly-Ground
  ☆11Updated 2 months ago
• kaistAI / factual-knowledge-acquisition
  ☆23Updated 2 weeks ago
• kaistAI / Knowledge-Entropy
  [ICLR 2025 Oral] Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition
  ☆16Updated last year
• lgresearch / QASA
  ☆31Updated 2 years ago
• dmis-lab / TouR
  Findings of ACL'2023: Optimizing Test-Time Query Representations for Dense Retrieval
  ☆30Updated 2 years ago
• zhongwanjun / CARP
  code for the table-based open domain question answering project, with paper title: "Reasoning over Hybrid Chain for Table-and-Text Open D…
  ☆12Updated 3 years ago
• xiangyue9607 / QVE
  Code for the ACL2022 paper "Synthetic Question Value Estimation for Domain Adaptation of Question Answering"
  ☆17Updated 3 years ago
• joeljang / FLM
  All-in-one repository for Fine-tuning & Pretraining (Large) Language Models
  ☆15Updated 2 years ago
• sean0042 / Open_WikiTable
  Open-WikiTable :Dataset for Open Domain Question Answering with Complex Reasoning over Table
  ☆28Updated 2 years ago
• MattYoon / reasoning-models-confidence
  [NeurIPS 2025] Reasoning Models Better Express Their Confidence"
  ☆21Updated 3 weeks ago
• joeljang / ELM
  [ICML 2023] Exploring the Benefits of Training Expert Language Models over Instruction Tuning
  ☆98Updated 2 years ago
• snu-mllab / Bayesian-Red-Teaming
  About Official PyTorch implementation of "Query-Efficient Black-Box Red Teaming via Bayesian Optimization" (ACL'23)
  ☆15Updated 2 years ago
• krafton-ai / MPC
  The git repository of Modular Prompted Chatbot paper
  ☆35Updated 2 years ago
• gauss5930 / iDUS
  An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.
  ☆13Updated last year
• kaistAI / Janus
  [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages
  ☆52Updated 4 months ago
• joeljang / temporalwiki
  [EMNLP 2022] TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models
  ☆74Updated last year
• emory-irlab / DUQGen
  Effective Unsupervised Domain Adaptation of Neural Rankers by Diversifying Synthetic Query Generation
  ☆15Updated 7 months ago
• kyle8581 / DialogueCoT
  [EMNLP 2023] Official repository for Dialogue Chain-of-Thought Distillation (DONUT & DOCTOR)
  ☆11Updated 2 years ago
• kaistAI / knowledge-reasoning
  [EMNLP 2024] Official implementation of "Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Ut…
  ☆23Updated last year
• HanjieChen / REV
  Code for the paper "REV: Information-Theoretic Evaluation of Free-Text Rationales"
  ☆16Updated 2 years ago
• skywalker023 / fantom
  👻 Code and benchmark for our EMNLP 2023 paper - "FANToM: A Benchmark for Stress-testing Machine Theory of Mind in Interactions"
  ☆57Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 3 years ago
• lfy79001 / RegHNT
  Code for COLING 2022 long paper: Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-…
  ☆22Updated 2 years ago