A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
☆417Apr 13, 2025Updated 10 months ago
Alternatives and similar repositories for FActScore
Users that are interested in FActScore are comparing it to the libraries listed below
Sorting:
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆554Feb 12, 2024Updated 2 years ago
- Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.☆114Jan 6, 2024Updated 2 years ago
- ☆89Nov 11, 2022Updated 3 years ago
- ☆39May 2, 2024Updated last year
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆602Jun 26, 2024Updated last year
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆511Oct 9, 2024Updated last year
- ☆17May 28, 2024Updated last year
- Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".☆667Feb 5, 2026Updated 3 weeks ago
- Codebase, data and models for the SummaC paper in TACL☆109Jan 30, 2025Updated last year
- ☆282Jan 6, 2025Updated last year
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆152Mar 11, 2024Updated last year
- Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …☆1,076Sep 27, 2025Updated 5 months ago
- ☆187Jul 2, 2025Updated 8 months ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆63Dec 25, 2023Updated 2 years ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆42Dec 15, 2023Updated 2 years ago
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆137Mar 14, 2024Updated last year
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆258Feb 21, 2023Updated 3 years ago
- ☆39Jun 7, 2023Updated 2 years ago
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆16Nov 5, 2024Updated last year
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆309May 1, 2025Updated 10 months ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆541Jan 17, 2025Updated last year
- ☆49Jan 7, 2024Updated 2 years ago
- FactScoreLite is an implementation of the FactScore metric, designed for detailed accuracy assessment in text generation. This package bu…☆13Apr 25, 2024Updated last year
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Mar 8, 2023Updated 2 years ago
- The repository for the survey paper <<Survey on Large Language Models Factuality: Knowledge, Retrieval and Domain-Specificity>>☆341Apr 25, 2024Updated last year
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆84Feb 20, 2026Updated last week
- TruthfulQA: Measuring How Models Imitate Human Falsehoods☆886Jan 16, 2025Updated last year
- Do Large Language Models Know What They Don’t Know?☆102Nov 8, 2024Updated last year
- FacTool: Factuality Detection in Generative AI☆913Aug 19, 2024Updated last year
- ☆33Dec 17, 2025Updated 2 months ago
- ☆58Jun 30, 2023Updated 2 years ago
- Token-level Reference-free Hallucination Detection☆98Jul 25, 2023Updated 2 years ago
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆158Jan 6, 2023Updated 3 years ago
- List of papers on hallucination detection in LLMs.☆1,053Jan 11, 2026Updated last month
- FRANK: Factuality Evaluation Benchmark☆59Dec 13, 2022Updated 3 years ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆572Jan 28, 2025Updated last year
- Companion repo for "Evaluating Verifiability in Generative Search Engines".☆85May 12, 2023Updated 2 years ago
- ☆55Mar 27, 2023Updated 2 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Apr 15, 2022Updated 3 years ago