TruthfulQA: Measuring How Models Imitate Human Falsehoods
☆885Jan 16, 2025Updated last year
Alternatives and similar repositories for TruthfulQA
Users that are interested in TruthfulQA are comparing it to the libraries listed below
Sorting:
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆554Feb 12, 2024Updated 2 years ago
- Code and data for the FACTOR paper☆53Nov 15, 2023Updated 2 years ago
- ☆89Nov 11, 2022Updated 3 years ago
- Dataset and evaluation script for "Evaluating Hallucinations in Chinese Large Language Models"☆136Jun 5, 2024Updated last year
- Measuring Massive Multitask Language Understanding | ICLR 2021☆1,557May 28, 2023Updated 2 years ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆571Jan 28, 2025Updated last year
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆541Jan 17, 2025Updated last year
- A framework for few-shot evaluation of language models.☆11,478Feb 15, 2026Updated last week
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆415Apr 13, 2025Updated 10 months ago
- Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models☆3,207Jul 19, 2024Updated last year
- Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …☆1,076Sep 27, 2025Updated 5 months ago
- ☆229Feb 23, 2021Updated 5 years ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,816Jun 17, 2025Updated 8 months ago
- An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.☆1,953Aug 9, 2025Updated 6 months ago
- ☆12Mar 7, 2024Updated last year
- Teaching Models to Express Their Uncertainty in Words☆39May 26, 2022Updated 3 years ago
- Code for the paper "Evaluating Large Language Models Trained on Code"☆3,137Jan 17, 2025Updated last year
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆602Jun 26, 2024Updated last year
- A prize for finding tasks that cause large language models to show inverse scaling☆620Oct 11, 2023Updated 2 years ago
- ☆772Jun 13, 2024Updated last year
- ☆284Mar 2, 2024Updated last year
- ☆1,393Jan 21, 2024Updated 2 years ago
- [ICML 2024] TrustLLM: Trustworthiness in Large Language Models☆618Jun 24, 2025Updated 8 months ago
- Holistic Evaluation of Language Models (HELM) is an open source Python framework created by the Center for Research on Foundation Models …☆2,684Updated this week
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆548Jun 25, 2024Updated last year
- This repo contains the code for generating the ToxiGen dataset, published at ACL 2022.☆346Jun 17, 2024Updated last year
- Train transformer language models with reinforcement learning.☆17,460Updated this week
- Token-level Reference-free Hallucination Detection☆98Jul 25, 2023Updated 2 years ago
- Locating and editing factual associations in GPT (NeurIPS 2022)☆728Apr 20, 2024Updated last year
- Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"☆143Mar 26, 2024Updated last year
- BeHonest: Benchmarking Honesty in Large Language Models☆34Aug 15, 2024Updated last year
- Representation Engineering: A Top-Down Approach to AI Transparency☆951Aug 14, 2024Updated last year
- The MATH Dataset (NeurIPS 2021)☆1,307Sep 6, 2025Updated 5 months ago
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark☆471Sep 30, 2024Updated last year
- Benchmarking large language models' complex reasoning ability with chain-of-thought prompting☆2,766Aug 4, 2024Updated last year
- ☆21Aug 19, 2024Updated last year
- A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)☆4,741Jan 8, 2024Updated 2 years ago
- AllenAI's post-training codebase☆3,592Updated this week
- Do Large Language Models Know What They Don’t Know?☆102Nov 8, 2024Updated last year