Codebase, data and models for the SummaC paper in TACL
☆109Jan 30, 2025Updated last year
Alternatives and similar repositories for summac
Users that are interested in summac are comparing it to the libraries listed below
Sorting:
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆309May 1, 2025Updated 10 months ago
- ☆55Mar 27, 2023Updated 2 years ago
- ☆103Mar 4, 2024Updated 2 years ago
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)☆28Mar 26, 2024Updated last year
- FRANK: Factuality Evaluation Benchmark☆59Dec 13, 2022Updated 3 years ago
- ☆46May 26, 2023Updated 2 years ago
- ☆32May 10, 2024Updated last year
- ☆28Nov 29, 2022Updated 3 years ago
- Factual consistency checking model for abstractive summaries (NAACL-22 Findings)☆30May 7, 2022Updated 3 years ago
- ☆39Jun 7, 2023Updated 2 years ago
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆417Apr 13, 2025Updated 10 months ago
- ☆78May 3, 2024Updated last year
- Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.☆34Jul 25, 2023Updated 2 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Apr 15, 2022Updated 3 years ago
- ☆14Aug 30, 2023Updated 2 years ago
- A zero-shot faithfulness evaluation metric for text summarization☆11Oct 17, 2023Updated 2 years ago
- Implementation for Decision-focused Summarization (EMNLP2021)☆12Mar 14, 2022Updated 3 years ago
- Codebase, data and models for the Headline Grouping paper at NAACL2021☆12Oct 2, 2022Updated 3 years ago
- ☆15Aug 3, 2021Updated 4 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆367Jun 27, 2022Updated 3 years ago
- Companion repo for "Evaluating Verifiability in Generative Search Engines".☆85May 12, 2023Updated 2 years ago
- FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Data (NAACL 2025)☆15Jul 14, 2025Updated 7 months ago
- Mutual Information Predicts Hallucinations in Abstractive Summarization☆13Nov 14, 2022Updated 3 years ago
- ☆24May 26, 2022Updated 3 years ago
- The implementation of <Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation> in PyTorch.☆17Nov 11, 2021Updated 4 years ago
- Source code of our EMNLP 2024 paper "FactAlign: Long-form Factuality Alignment of Large Language Models"☆19Oct 3, 2024Updated last year
- ACL 2021 paper "Style is NOT a single variable: Case Studies for Cross-Style Language Understanding " by Dongyeop Kang and Eduard Hovy☆15Jul 19, 2021Updated 4 years ago
- 📄 Evidence Retrieval and Claim Verification for the FEVER shared task using Transformer Networks☆12Feb 21, 2020Updated 6 years ago
- FactSumm: Factual Consistency Scorer for Abstractive Summarization☆113Jan 1, 2024Updated 2 years ago
- ☆22Feb 26, 2024Updated 2 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Nov 26, 2020Updated 5 years ago
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆411Jun 23, 2024Updated last year
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆42Dec 15, 2023Updated 2 years ago
- GSum: A General Framework for Guided Neural Abstractive Summarization☆116Sep 22, 2025Updated 5 months ago
- Source Code of Paper "GPTScore: Evaluate as You Desire"☆258Feb 21, 2023Updated 3 years ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆96Dec 8, 2022Updated 3 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆73Sep 22, 2025Updated 5 months ago
- ☆13Jul 26, 2023Updated 2 years ago