SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
☆149Oct 22, 2022Updated 4 years ago
Alternatives and similar repositories for sacrerouge
Users that are interested in sacrerouge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆418Jun 23, 2024Updated 2 years ago
- ☆15Aug 3, 2021Updated 5 years ago
- ☆58Jun 2, 2026Updated 4 months ago
- Method for evaluating system summaries manually, via crowdsourcing, using a summarization dataset that includes reference summaries.☆12May 5, 2019Updated 7 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆73Sep 22, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆106Mar 4, 2024Updated 2 years ago
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆214Nov 20, 2023Updated 2 years ago
- ☆45May 26, 2023Updated 3 years ago
- ☆16May 22, 2022Updated 4 years ago
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆304May 1, 2025Updated last year
- Data for the ACL SRW 2020 paper "Understanding Points of Correspondence between Sentences for Abstractive Summarization"☆20Nov 2, 2022Updated 3 years ago
- ☆23May 26, 2022Updated 4 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Nov 26, 2020Updated 5 years ago
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A tool for holistic analysis of language generations systems☆471Sep 22, 2025Updated last year
- Code for Massive-scale Decoding for Text Generation using Lattices☆44Jul 29, 2022Updated 4 years ago
- ☆24May 31, 2024Updated 2 years ago
- Codebase, data and models for the SummaC paper in TACL☆110Jan 30, 2025Updated last year
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆59Jan 12, 2023Updated 3 years ago
- Repro is a library for easily running code from published papers via Docker.☆42Sep 22, 2023Updated 3 years ago
- BARTScore: Evaluating Generated Text as Text Generation☆370Jun 27, 2022Updated 4 years ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆96Dec 8, 2022Updated 3 years ago
- This is the official code for the paper 'Systematically Exploring Redundancy Reduction inSummarizing Long Documents'.☆15Apr 30, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Full Python implementation of the ROUGE metric, producing same results as in the official perl implementation.☆156Jul 10, 2019Updated 7 years ago
- GSum: A General Framework for Guided Neural Abstractive Summarization☆115Sep 22, 2025Updated last year
- MT Evaluation in Many Languages via Zero-Shot Paraphrasing☆102Jul 25, 2024Updated 2 years ago
- Improved ParaBank Rewriter☆22Jan 22, 2020Updated 6 years ago
- BERT score for text generation☆1,923Jul 30, 2024Updated 2 years ago
- Code for ACL 2020 paper: "Extractive Summarization as Text Matching"☆520Jan 11, 2022Updated 4 years ago
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)☆29Mar 26, 2024Updated 2 years ago
- Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons☆1,265Aug 20, 2026Updated 2 months ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆45Aug 10, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [NeurIPS 2024 D&B] Evaluating Copyright Takedown Methods for Language Models☆17Jul 17, 2024Updated 2 years ago
- One implementation of the paper "Controllable Neural Dialogue Summarization with Personal Named Entity Planning" (EMNLP 2022).☆18Nov 9, 2023Updated 2 years ago
- ☆216Nov 12, 2021Updated 4 years ago
- Topic-Aware Convolutional Neural Networks for Extreme Summarization☆378Jun 20, 2023Updated 3 years ago
- Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.☆16Oct 28, 2024Updated 2 years ago
- FactSumm: Factual Consistency Scorer for Abstractive Summarization☆113Jan 1, 2024Updated 2 years ago
- SummVis is an interactive visualization tool for text summarization.☆254Jun 17, 2022Updated 4 years ago