Alternatives and similar repositories for IHEval

Users that are interested in IHEval are comparing it to the libraries listed below

• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆127Updated last year
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆62Updated last year
• BunsenFeng / AbstainQA
  AbstainQA, ACL 2024
  ☆28Updated last year
• pillowsofwind / Knowledge-Conflicts-Survey
  [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"
  ☆150Updated last year
• jinzhuoran / RWKU
  RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024
  ☆87Updated last year
• ChenmienTan / malmen
  ☆36Updated last year
• zchuz / TimeBench
  The repository for ACL 2024 paper "TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models"
  ☆33Updated last year
• OSU-NLP-Group / LLM-Knowledge-Conflict
  [ICLR'24 Spotlight] "Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts"
  ☆82Updated last year
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆118Updated last year
• jinhaoduan / SAR
  [ACL 2024] Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models
  ☆60Updated last year
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆68Updated last year
• Glaciohound / LM-Steer
  Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)
  ☆134Updated 5 months ago
• katiekang1998 / llm_hallucinations
  ☆17Updated last year
• tatsu-lab / test_set_contamination
  ☆41Updated 2 years ago
• ADaM-BJTU / W2SG
  The code of “Improving Weak-to-Strong Generalization with Scalable Oversight and Ensemble Learning”
  ☆17Updated last year
• edenbiran / RippleEdits
  Evaluating the Ripple Effects of Knowledge Editing in Language Models
  ☆55Updated last year
• zepingyu0512 / neuron-attribution
  code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models
  ☆48Updated last year
• xingyaoww / mint-bench
  Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…
  ☆134Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆71Updated 3 years ago
• zhenyu-02 / LogitLens4LLMs
  A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…
  ☆142Updated 4 months ago
• icip-cas / Verifier-Engineering
  Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
  ☆63Updated last year
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆91Updated last year
• kevinyaobytedance / llm_unlearn
  LLM Unlearning
  ☆178Updated 2 years ago
• RUCAIBox / HaluEval-2.0
  ☆48Updated 2 years ago
• LaMP-Benchmark / LaMP
  Codes for papers on Large Language Models Personalization (LaMP)
  ☆180Updated 10 months ago
• WeiminXiong / IPR
  Watch Every Step! LLM Agent Learning via Iterative Step-level Process Refinement (EMNLP 2024 Main Conference)
  ☆64Updated last year
• Yangyi-Chen / PaperList-Trustworthy-Applications
  Mostly recording papers about models' trustworthy applications. Intending to include topics like model evaluation & analysis, security, c…
  ☆21Updated 2 years ago
• SuperBruceJia / Awesome-LLM-Self-Consistency
  Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models
  ☆117Updated 5 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆98Updated last year
• ZeroYuHuang / Transformer-Patcher
  ☆32Updated 2 years ago