SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
☆149Oct 22, 2022Updated 3 years ago
Alternatives and similar repositories for sacrerouge
Users that are interested in sacrerouge are comparing it to the libraries listed below
Sorting:
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆411Jun 23, 2024Updated last year
- ☆15Aug 3, 2021Updated 4 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆73Sep 22, 2025Updated 5 months ago
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆309May 1, 2025Updated 10 months ago
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆211Nov 20, 2023Updated 2 years ago
- ☆103Mar 4, 2024Updated last year
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Nov 26, 2020Updated 5 years ago
- Data for the ACL SRW 2020 paper "Understanding Points of Correspondence between Sentences for Abstractive Summarization"☆20Nov 2, 2022Updated 3 years ago
- A tool for holistic analysis of language generations systems☆471Sep 22, 2025Updated 5 months ago
- This is the official code for the paper 'Systematically Exploring Redundancy Reduction inSummarizing Long Documents'.☆16Apr 30, 2021Updated 4 years ago
- ☆16May 22, 2022Updated 3 years ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆96Dec 8, 2022Updated 3 years ago
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆59Jan 12, 2023Updated 3 years ago
- Multilingual abstractive summarization dataset extracted from WikiHow.☆99Mar 14, 2025Updated 11 months ago
- Improved ParaBank Rewriter☆22Jan 22, 2020Updated 6 years ago
- GSum: A General Framework for Guided Neural Abstractive Summarization☆116Sep 22, 2025Updated 5 months ago
- ☆46May 26, 2023Updated 2 years ago
- ☆24May 31, 2024Updated last year
- Full Python implementation of the ROUGE metric, producing same results as in the official perl implementation.☆159Jul 10, 2019Updated 6 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆367Jun 27, 2022Updated 3 years ago
- Topic-Aware Convolutional Neural Networks for Extreme Summarization☆376Jun 20, 2023Updated 2 years ago
- Question Answering and Generation for Summarization☆71Nov 27, 2022Updated 3 years ago
- XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 ty…☆651Jan 4, 2023Updated 3 years ago
- EMNLP 2020 - Summarizing Text on Any Aspects☆38Feb 4, 2021Updated 5 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,227Jan 12, 2026Updated last month
- ☆15Nov 5, 2020Updated 5 years ago
- MT Evaluation in Many Languages via Zero-Shot Paraphrasing☆102Jul 25, 2024Updated last year
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)☆28Mar 26, 2024Updated last year
- Dynamic ensemble decoding with transformer-based models☆29Jun 12, 2023Updated 2 years ago
- BERT score for text generation☆1,873Jul 30, 2024Updated last year
- Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive…☆439May 26, 2025Updated 9 months ago
- Datasets for EMNLP-IJCNLP 2019 paper "NCLS:Neural Cross-Lingual Summarization"☆74Nov 18, 2020Updated 5 years ago
- Expanded KR-BERT by adding more training data☆12Apr 23, 2021Updated 4 years ago
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆16Nov 5, 2024Updated last year
- Method for evaluating system summaries manually, via crowdsourcing, using a summarization dataset that includes reference summaries.☆12May 5, 2019Updated 6 years ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆44Aug 10, 2024Updated last year
- code for EMNLP 2019 paper Text Summarization with Pretrained Encoders☆1,304Jul 25, 2024Updated last year
- Code for ACL 2020 paper: "Extractive Summarization as Text Matching"☆522Jan 11, 2022Updated 4 years ago
- Well tested & Multi-language evaluation framework for text summarization.☆625Jul 15, 2022Updated 3 years ago