FRANK: Factuality Evaluation Benchmark
☆59Dec 13, 2022Updated 3 years ago
Alternatives and similar repositories for frank
Users that are interested in frank are comparing it to the libraries listed below
Sorting:
- ☆46May 26, 2023Updated 2 years ago
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆309May 1, 2025Updated 10 months ago
- Factual consistency checking model for abstractive summaries (NAACL-22 Findings)☆30May 7, 2022Updated 3 years ago
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆48Jun 12, 2023Updated 2 years ago
- Codebase, data and models for the SummaC paper in TACL☆109Jan 30, 2025Updated last year
- ☆24May 31, 2024Updated last year
- ☆14Aug 30, 2023Updated 2 years ago
- PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022)☆40Sep 15, 2022Updated 3 years ago
- ☆39Jun 7, 2023Updated 2 years ago
- Question Answering and Generation for Summarization☆73Nov 27, 2022Updated 3 years ago
- ☆15Aug 3, 2021Updated 4 years ago
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)☆28Mar 26, 2024Updated last year
- ☆27Nov 6, 2022Updated 3 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Apr 15, 2022Updated 3 years ago
- ☆24May 26, 2022Updated 3 years ago
- Implementation of the paper "FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations (NAACL 2022)"☆50Jul 26, 2023Updated 2 years ago
- ☆103Mar 4, 2024Updated 2 years ago
- ☆18May 5, 2021Updated 4 years ago
- GSum: A General Framework for Guided Neural Abstractive Summarization☆116Sep 22, 2025Updated 5 months ago
- Codes for NAACL 2021 paper 'Noisy Self-Knowledge Distillation for Text Summarization'☆24Jul 27, 2021Updated 4 years ago
- Source codes for the paper "Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue Summarization"☆91Oct 27, 2023Updated 2 years ago
- Source codes for "Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs"☆65Oct 27, 2023Updated 2 years ago
- Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"☆143Aug 29, 2023Updated 2 years ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆44Aug 10, 2024Updated last year
- REALSumm: Re-evaluating Evaluation in Text Summarization☆73Sep 22, 2025Updated 5 months ago
- ☆10May 26, 2022Updated 3 years ago
- EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization☆13Mar 20, 2025Updated 11 months ago
- This repository provides the source code used to automatically generate the book summarization datasets described in the paper titled "Ec…☆10Apr 14, 2025Updated 10 months ago
- Code for EMNLP 2021 paper "CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization"☆46Jan 17, 2022Updated 4 years ago
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆412Jun 23, 2024Updated last year
- [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees☆24Jun 19, 2023Updated 2 years ago
- ☆12Feb 18, 2020Updated 6 years ago
- Open Source / ENTSUM: A Data Set for Entity-Centric Extractive Summarization☆29May 23, 2022Updated 3 years ago
- This repository contains the source code and links to some datasets used in the CoNLL 2019 paper "Learning to Represent Bilingual Diction…☆12Oct 1, 2020Updated 5 years ago
- Dataset and Codes for our EMNLP 2022 Main Conference Long Paper titled "ECTSum: A New Benchmark Dataset For Bullet Point Summarization of…☆32May 22, 2024Updated last year
- Codes for our ACL21 paper: Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarization☆95Aug 2, 2021Updated 4 years ago
- ☆14Jan 10, 2024Updated 2 years ago
- Few-shot NLP benchmark for unified, rigorous eval☆93Jul 12, 2022Updated 3 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆367Jun 27, 2022Updated 3 years ago