Alternatives and similar repositories for DomainEval

Users that are interested in DomainEval are comparing it to the libraries listed below

• YihongDong / CDD-TED4LLMs
  ☆14Updated 8 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆62Updated 8 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆28Updated 8 months ago
• ntunlp / LLMSanitize
  An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).
  ☆57Updated 11 months ago
• liyucheng09 / Contamination_Detector
  Lightweight tool to identify Data Contamination in LLMs evaluation
  ☆51Updated last year
• UKPLab / acl2025-diverse-cot
  Code for the 2025 ACL publication "Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs"
  ☆29Updated last month
• jszheng21 / RACE
  RACE is a multi-dimensional benchmark for code generation that focuses on Readability, mAintainability, Correctness, and Efficiency.
  ☆10Updated 9 months ago
• feiyang-k / AutoScale
  Official Code Repository for [AutoScale–Automatic Prediction of Compute-optimal Data Compositions for Training LLMs]
  ☆12Updated 6 months ago
• OrangeInSouth / DeePEn
  A method of ensemble learning for heterogeneous large language models.
  ☆58Updated last year
• pillowsofwind / Course-Correction
  [EMNLP 2024] The official GitHub repo for the paper "Course-Correction: Safety Alignment Using Synthetic Preferences"
  ☆19Updated 10 months ago
• Princeton-SysML / kNNLM_privacy
  Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888
  ☆36Updated last year
• halfrot / ALaRM
  [ACL 2024] Code for the paper "ALaRM: Align Language Models via Hierarchical Rewards Modeling"
  ☆25Updated last year
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆38Updated last year
• hanxuhu / SeqIns
  The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…
  ☆29Updated 8 months ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆73Updated 8 months ago
• qiuzh20 / EMoE
  Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]
  ☆32Updated last year
• lyy1994 / awesome-data-contamination
  The Paper List on Data Contamination for Large Language Models Evaluation.
  ☆98Updated 3 weeks ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆68Updated 2 years ago
• NJUNLP / MAPO
  The implement of ACL2024: "MAPO: Advancing Multilingual Reasoning through Multilingual Alignment-as-Preference Optimization"
  ☆42Updated last year
• HillZhang1999 / ICD
  Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"
  ☆68Updated last year
• alestolfo / lm-arithmetic
  Code for the paper "A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysis"
  ☆18Updated last month
• lifan-yuan / OOD_NLP
  [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…
  ☆34Updated 2 years ago
• GAIR-NLP / ReasonEval
  [AAAI 2025 oral] Evaluating Mathematical Reasoning Beyond Accuracy
  ☆65Updated 7 months ago
• dvlab-research / Mr-Ben
  This is the repo for our paper "Mr-Ben: A Comprehensive Meta-Reasoning Benchmark for Large Language Models"
  ☆50Updated 9 months ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• wutaiqiang / LLM_KD_AKL
  ☆16Updated 9 months ago
• zhaochen0110 / Cotempqa
  Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)
  ☆32Updated last year
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆114Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆62Updated last year