A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"
☆436Apr 13, 2025Updated last year
Alternatives and similar repositories for FActScore
Users that are interested in FActScore are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fact-Checking the Output of Generative Large Language Models in both Annotation and Evaluation.☆115Jan 6, 2024Updated 2 years ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆581Feb 12, 2024Updated 2 years ago
- ☆39May 2, 2024Updated 2 years ago
- Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".☆685Updated this week
- ☆90Nov 11, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆18May 28, 2024Updated last year
- Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large …☆1,083Sep 27, 2025Updated 7 months ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆64Dec 25, 2023Updated 2 years ago
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆163Mar 11, 2024Updated 2 years ago
- Codebase, data and models for the SummaC paper in TACL☆109Jan 30, 2025Updated last year
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆613Jun 26, 2024Updated last year
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆517Oct 9, 2024Updated last year
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆42Dec 15, 2023Updated 2 years ago
- ☆40Jun 7, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [Data + code] ExpertQA : Expert-Curated Questions and Attributed Answers☆138Mar 14, 2024Updated 2 years ago
- ☆284Jan 6, 2025Updated last year
- ☆189Jul 2, 2025Updated 10 months ago
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆16Nov 5, 2024Updated last year
- FacTool: Factuality Detection in Generative AI☆928Aug 19, 2024Updated last year
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆555Jan 17, 2025Updated last year
- TruthfulQA: Measuring How Models Imitate Human Falsehoods☆919Jan 16, 2025Updated last year
- ☆35Dec 17, 2025Updated 5 months ago
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆307May 1, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆50Jan 7, 2024Updated 2 years ago
- List of papers on hallucination detection in LLMs.☆1,090Apr 23, 2026Updated last month
- The original implementation of Min et al. "Nonparametric Masked Language Modeling" (paper https//arxiv.org/abs/2212.01349)☆158Jan 6, 2023Updated 3 years ago
- Do Large Language Models Know What They Don’t Know?☆102Nov 8, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆580Jan 28, 2025Updated last year
- The repository for the survey paper <<Survey on Large Language Models Factuality: Knowledge, Retrieval and Domain-Specificity>>☆339Mar 28, 2026Updated last month
- Companion repo for "Evaluating Verifiability in Generative Search Engines".☆85May 12, 2023Updated 3 years ago
- Token-level Reference-free Hallucination Detection☆98Jul 25, 2023Updated 2 years ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆259Feb 21, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆87May 12, 2026Updated last week
- This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…☆2,381May 25, 2024Updated 2 years ago
- ☆58Jun 30, 2023Updated 2 years ago
- [ACL 2024] ANAH & [NeurIPS 2024] ANAH-v2 & [ICLR 2025] Mask-DPO☆64Apr 30, 2025Updated last year
- FactScoreLite is an implementation of the FactScore metric, designed for detailed accuracy assessment in text generation. This package bu…☆14Apr 25, 2024Updated 2 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Apr 15, 2022Updated 4 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆369Jun 27, 2022Updated 3 years ago