Alternatives and similar repositories for counterfactual-evaluation

Users that are interested in counterfactual-evaluation are comparing it to the libraries listed below

• cicl-stanford / procedural-evals-tom
  ☆32Updated last year
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• YuxiXie / SelfEval-Guided-Decoding
  ☆98Updated last year
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆16Updated last year
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆108Updated last year
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆30Updated last year
• matt-seb-ho / WikiWhy
  WikiWhy is a new benchmark for evaluating LLMs' ability to explain between cause-effect relationships. It is a QA dataset containing 9000…
  ☆47Updated last year
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆60Updated 2 years ago
• Zce1112zslx / IKE
  ☆41Updated last year
• linlu-qiu / lm-inductive-reasoning
  ☆34Updated last year
• archiki / ReCEval
  Supporting code for ReCEval paper
  ☆28Updated 9 months ago
• hkust-nlp / felm
  Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)
  ☆59Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆40Updated 2 years ago
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 9 months ago
• GAIR-NLP / alignment-for-honesty
  ☆74Updated last year
• allenai / noncompliance
  This repository contains data, code and models for contextual noncompliance.
  ☆23Updated 11 months ago
• chang-github-00 / LLM-Predictive-Decoding
  ☆13Updated 7 months ago
• yuzhaouoe / SAE-based-representation-engineering
  [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering
  ☆60Updated 7 months ago
• GXimingLu / Quark
  ☆75Updated last year
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated last year
• sylinrl / CalibratedMath
  Teaching Models to Express Their Uncertainty in Words
  ☆39Updated 3 years ago
• Edward-Sun / easy-to-hard
  Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision
  ☆121Updated 9 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• GAIR-NLP / BeHonest
  BeHonest: Benchmarking Honesty in Large Language Models
  ☆34Updated 10 months ago
• evandez / REMEDI
  Inspecting and Editing Knowledge Representations in Language Models
  ☆116Updated last year
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• nayeon7lee / FactualityPrompt
  ☆86Updated 2 years ago
• princeton-nlp / MQuAKE
  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions
  ☆112Updated 9 months ago
• ruiqi-zhong / nlparam
  Augmenting Statistical Models with Natural Language Parameters
  ☆27Updated 9 months ago
• dannyallover / overthinking_the_truth
  ☆29Updated last year