Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (https://www.aclweb.org/anthology/2020.acl-main.173.pdf).
☆84Nov 26, 2020Updated 5 years ago
Alternatives and similar repositories for xsum_hallucination_annotations
Users that are interested in xsum_hallucination_annotations are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Detect hallucinated tokens for conditional sequence generation.☆64Apr 15, 2022Updated 3 years ago
- The implementation of <Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation> in PyTorch.☆17Nov 11, 2021Updated 4 years ago
- FactSumm: Factual Consistency Scorer for Abstractive Summarization☆113Jan 1, 2024Updated 2 years ago
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆308May 1, 2025Updated 10 months ago
- ☆46May 26, 2023Updated 2 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Question Answering and Generation for Summarization☆72Nov 27, 2022Updated 3 years ago
- ☆16Mar 27, 2023Updated 2 years ago
- FRANK: Factuality Evaluation Benchmark☆59Dec 13, 2022Updated 3 years ago
- Topic-Aware Convolutional Neural Networks for Extreme Summarization☆376Jun 20, 2023Updated 2 years ago
- ☆27Nov 29, 2022Updated 3 years ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆42Dec 15, 2023Updated 2 years ago
- ☆40Jun 2, 2021Updated 4 years ago
- Data for the ACL SRW 2020 paper "Understanding Points of Correspondence between Sentences for Abstractive Summarization"☆20Nov 2, 2022Updated 3 years ago
- ☆18Apr 11, 2021Updated 4 years ago
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆150Oct 22, 2022Updated 3 years ago
- ☆103Mar 4, 2024Updated 2 years ago
- ☆14Jun 10, 2019Updated 6 years ago
- ACL 2021☆27May 24, 2022Updated 3 years ago
- ☆27Nov 6, 2022Updated 3 years ago
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆413Jun 23, 2024Updated last year
- ☆49Jun 12, 2023Updated 2 years ago
- The code repository for NAACL 2021 paper "AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarization".☆35May 10, 2021Updated 4 years ago
- Supporting code for the EMNLP 2019 paper "Answers Unite! Unsupervised Metrics for Reinforced Summarization Models"☆14Jun 12, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆13Jul 26, 2023Updated 2 years ago
- Evaluation results for Machine Translation within the BigScience project☆11May 15, 2023Updated 2 years ago
- EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation☆97Mar 20, 2023Updated 3 years ago
- Test code of Inverse cloze task for information retrieval☆33Jan 10, 2021Updated 5 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆367Jun 27, 2022Updated 3 years ago
- GSum: A General Framework for Guided Neural Abstractive Summarization☆115Sep 22, 2025Updated 6 months ago
- PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022)☆40Sep 15, 2022Updated 3 years ago
- A benchmark dataset for evaluating dialog system and natural language generation metrics.☆39Jun 13, 2022Updated 3 years ago
- EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization☆13Mar 20, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- This repo contains code for the paper "Psychologically-informed chain-of-thought prompts for metaphor understanding in large language mod…☆14Apr 28, 2023Updated 2 years ago
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)☆28Mar 26, 2024Updated last year
- Code for paper "Discourse-Aware Neural Extractive Text Summarization" (ACL20)☆166Apr 25, 2020Updated 5 years ago
- About Data and Codes for EMNLP 2023 System Demo Paper "QACHECK: A Demonstration System for Question-Guided Multi-Hop Fact-Checking"☆19Dec 19, 2023Updated 2 years ago
- ☆12Nov 3, 2022Updated 3 years ago
- Applies ROME and MEMIT on Mamba-S4 models☆14Apr 5, 2024Updated last year
- Codebase, data and models for the SummaC paper in TACL☆108Jan 30, 2025Updated last year