Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper
☆412Jun 23, 2024Updated last year
Alternatives and similar repositories for SummEval
Users that are interested in SummEval are comparing it to the libraries listed below
Sorting:
- REALSumm: Re-evaluating Evaluation in Text Summarization☆73Sep 22, 2025Updated 5 months ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆150Oct 22, 2022Updated 3 years ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆96Dec 8, 2022Updated 3 years ago
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆211Nov 20, 2023Updated 2 years ago
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆309May 1, 2025Updated 10 months ago
- ☆39Jun 7, 2023Updated 2 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆367Jun 27, 2022Updated 3 years ago
- Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation☆215Feb 10, 2024Updated 2 years ago
- Large-scale multi-document summarization dataset and code☆293May 8, 2023Updated 2 years ago
- FactSumm: Factual Consistency Scorer for Abstractive Summarization☆113Jan 1, 2024Updated 2 years ago
- BERT score for text generation☆1,876Jul 30, 2024Updated last year
- Summarization Papers☆1,010Jul 15, 2023Updated 2 years ago
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆48Jun 12, 2023Updated 2 years ago
- Supporting code for the EMNLP 2019 paper "Answers Unite! Unsupervised Metrics for Reinforced Summarization Models"☆14Jun 12, 2023Updated 2 years ago
- BLEURT is a metric for Natural Language Generation based on transfer learning.☆786Aug 4, 2023Updated 2 years ago
- Resources for the NAACL 2018 paper "A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents"☆388Mar 24, 2023Updated 2 years ago
- ACL 2022: BRIO: Bringing Order to Abstractive Summarization☆337Oct 10, 2024Updated last year
- MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization☆81Jul 20, 2021Updated 4 years ago
- Method for evaluating system summaries manually, via crowdsourcing, using a summarization dataset that includes reference summaries.☆12May 5, 2019Updated 6 years ago
- Code for ACL 21: Generating Query Focused Summaries from Query-Free Resources☆33Jul 15, 2022Updated 3 years ago
- Code for ACL 2020 paper: "Extractive Summarization as Text Matching"☆522Jan 11, 2022Updated 4 years ago
- Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive…☆439May 26, 2025Updated 9 months ago
- ☆13Sep 27, 2022Updated 3 years ago
- Human-free quality estimation of document summaries☆97Dec 1, 2025Updated 3 months ago
- ☆103Mar 4, 2024Updated 2 years ago
- The implementation of <Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation> in PyTorch.☆17Nov 11, 2021Updated 4 years ago
- Question Answering and Generation for Summarization☆73Nov 27, 2022Updated 3 years ago
- An open-source text summarization toolkit for non-experts. EMNLP'2021 Demo☆280Sep 30, 2023Updated 2 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Nov 26, 2020Updated 5 years ago
- Topic-Aware Convolutional Neural Networks for Extreme Summarization☆376Jun 20, 2023Updated 2 years ago
- FRANK: Factuality Evaluation Benchmark☆59Dec 13, 2022Updated 3 years ago
- Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"☆143Aug 29, 2023Updated 2 years ago
- ☆44Jul 29, 2019Updated 6 years ago
- Code for ACL2021 paper: "GLGE: A New General Language Generation Evaluation Benchmark"☆57Oct 26, 2022Updated 3 years ago
- Data for the ACL SRW 2020 paper "Understanding Points of Correspondence between Sentences for Abstractive Summarization"☆20Nov 2, 2022Updated 3 years ago
- ☆46May 26, 2023Updated 2 years ago
- SummVis is an interactive visualization tool for text summarization.☆254Jun 17, 2022Updated 3 years ago
- The source code of our ACL paper "A Training-free and Reference-free Summarization Evaluation Metric via Centrality-weighted Relevance an…☆14May 6, 2023Updated 2 years ago
- Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)☆13Jun 2, 2021Updated 4 years ago