A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
☆456Apr 13, 2025Updated last year
Alternatives and similar repositories for FActScore
Users that are interested in FActScore are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.☆116Jan 6, 2024Updated 2 years ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆595Feb 12, 2024Updated 2 years ago
- ☆41May 2, 2024Updated 2 years ago
- Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".☆691Jun 18, 2026Updated last month
- ☆90Nov 11, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆18May 28, 2024Updated 2 years ago
- Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …☆1,084Sep 27, 2025Updated 10 months ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆65Dec 25, 2023Updated 2 years ago
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆167Mar 11, 2024Updated 2 years ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆629Jun 26, 2024Updated 2 years ago
- Codebase, data and models for the SummaC paper in TACL☆110Jan 30, 2025Updated last year
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆525Oct 9, 2024Updated last year
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆43Dec 15, 2023Updated 2 years ago
- ☆41Jun 7, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆139Mar 14, 2024Updated 2 years ago
- ☆283Jan 6, 2025Updated last year
- ☆193Jul 2, 2025Updated last year
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆16Nov 5, 2024Updated last year
- FacTool: Factuality Detection in Generative AI☆935Aug 19, 2024Updated last year
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆558Jul 12, 2026Updated last month
- TruthfulQA: Measuring How Models Imitate Human Falsehoods☆937Jan 16, 2025Updated last year
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆305May 1, 2025Updated last year
- ☆39Dec 17, 2025Updated 7 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆50Jan 7, 2024Updated 2 years ago
- List of papers on hallucination detection in LLMs.☆1,123Jul 24, 2026Updated 2 weeks ago
- Companion repo for "Evaluating Verifiability in Generative Search Engines".☆87May 12, 2023Updated 3 years ago
- Do Large Language Models Know What They Don’t Know?☆103Nov 8, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆581Jan 28, 2025Updated last year
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆159Jan 6, 2023Updated 3 years ago
- FactScoreLite is an implementation of the FactScore metric, designed for detailed accuracy assessment in text generation. This package bu…☆14Apr 25, 2024Updated 2 years ago
- The repository for the survey paper <<Survey on Large Language Models Factuality: Knowledge, Retrieval and Domain-Specificity>>☆339Mar 28, 2026Updated 4 months ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆258Feb 21, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Token-level Reference-free Hallucination Detection☆97Jul 25, 2023Updated 3 years ago
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆92Jun 16, 2026Updated last month
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆2,416May 25, 2024Updated 2 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Apr 15, 2022Updated 4 years ago
- ☆58Jun 30, 2023Updated 3 years ago
- [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO☆67Apr 30, 2025Updated last year
- BARTScore: Evaluating Generated Text as Text Generation☆369Jun 27, 2022Updated 4 years ago