Alternatives and similar repositories for IHEval

Users that are interested in IHEval are comparing it to the libraries listed below

• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆77Updated last year
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆118Updated last year
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆67Updated 11 months ago
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆148Updated last year
• ChenmienTan / malmen
  ☆35Updated last year
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆62Updated last year
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆121Updated last year
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆28Updated last year
• zepingyu0512 / neuron-attribution
  code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models
  ☆47Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆69Updated 3 years ago
• edenbiran / RippleEdits
  Evaluating the Ripple Effects of Knowledge Editing in Language Models
  ☆55Updated last year
• zhiyuanhubj / UoT
  [NeurIPS 2024] Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models
  ☆103Updated last year
• shizhediao / R-Tuning
  [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…
  ☆125Updated last year
• zchuz / TimeBench
  The repository for ACL 2024 paper "TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models"
  ☆32Updated last year
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆62Updated 11 months ago
• zepingyu0512 / awesome-SAE
  awesome SAE papers
  ☆59Updated 5 months ago
• ADaM-BJTU / W2SG
  The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”
  ☆17Updated last year
• iQua / llmpebase
  This is a unified platform for implementing and evaluating test-time reasoning mechanisms in Large Language Models (LLMs).
  ☆19Updated 10 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆63Updated last year
• ZeroYuHuang / Transformer-Patcher
  ☆30Updated 2 years ago
• jinhaoduan / SAR
  [ACL 2024] Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models
  ☆59Updated last year
• SparkJiao / dpo-trajectory-reasoning
  [EMNLP 2024] Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".
  ☆82Updated 10 months ago
• jinzhuoran / RWKU
  RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024
  ☆86Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆133Updated last year
• RUCAIBox / HaluEval-2.0
  ☆47Updated last year
• Glaciohound / LM-Steer
  Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)
  ☆129Updated 4 months ago
• katiekang1998 / llm_hallucinations
  ☆17Updated last year
• Reason-Wang / NAT
  [NAACL 2025] The official implementation of paper "Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language M…
  ☆29Updated last year
• GAIR-NLP / alignment-for-honesty
  ☆76Updated last year
• TianHongZXY / RLVR-Decomposed
  [NeurIPS 2025] Implementation for the paper "The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning"
  ☆125Updated 3 weeks ago