Alternatives and similar repositories for DomainEval

Users that are interested in DomainEval are comparing it to the libraries listed below

• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆79Updated last year
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆36Updated 2 years ago
• YihongDong / CDD-TED4LLMs
  ☆16Updated last year
• CriticBench / CriticBench
  [ACL 2024 Findings] CriticBench: Benchmarking LLMs for Critique-Correct Reasoning
  ☆29Updated last year
• yyDing1 / ScaleQuest
  [ACL 2025] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLM…
  ☆68Updated last year
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆77Updated 3 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆65Updated last year
• TingchenFu / MathIF
  instruction-following benchmark for large reasoning models
  ☆44Updated 6 months ago
• pillowsofwind / Course-Correction
  [EMNLP 2024] The official GitHub repo for the paper "Course-Correction: Safety Alignment Using Synthetic Preferences"
  ☆20Updated last year
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆59Updated last year
• KwanWaiChung / MT-Eval
  Code and data for "MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models"
  ☆51Updated 2 months ago
• liyucheng09 / Contamination_Detector
  Lightweight tool to identify Data Contamination in LLMs evaluation
  ☆53Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆64Updated last year
• MrBlankness / TPO
  Pytorch implementation of Tree Preference Optimization (TPO) (Accepted by ICLR'25)
  ☆26Updated 9 months ago
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆83Updated last year
• SIMONLQY / RethinkMCTS
  ☆31Updated last year
• ChengpengLi1003 / DotaMath
  ☆30Updated last year
• koalazf99 / Awesome-DataCentric-LLM
  Trending projects & awesome papers about data-centric llm studies.
  ☆39Updated 8 months ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆26Updated last year
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆129Updated last year
• THU-KEG / VerIF
  [EMNLP 2025] Verification Engineering for RL in Instruction Following
  ☆50Updated last month
• ernie-research / Tool-Augmented-Reward-Model
  [ICLR'24 spotlight] Tool-Augmented Reward Modeling
  ☆53Updated 8 months ago
• tatsu-lab / test_set_contamination
  ☆41Updated 2 years ago
• OrangeInSouth / DeePEn
  A method of ensemble learning for heterogeneous large language models.
  ☆64Updated last year
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆36Updated last year
• lyy1994 / awesome-data-contamination
  The Paper List on Data Contamination for Large Language Models Evaluation.
  ☆109Updated last week
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆39Updated 2 years ago
• KodCode-AI / code-r1
  Reproducing R1 for Code with Reliable Rewards
  ☆12Updated 9 months ago
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆69Updated last year
• zwhong714 / adaptive_decoding
  [ICML2024]Adaptive decoding balances the diversity and coherence of open-ended text generation.
  ☆19Updated last year