danieldeutsch / sacrerouge
SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
☆139Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for sacrerouge
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆81Updated 3 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆71Updated last year
- A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations☆54Updated 2 years ago
- FRANK: Factuality Evaluation Benchmark☆52Updated last year
- This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".☆79Updated 3 years ago
- Dataset for NAACL 2021 paper: "DART: Open-Domain Structured Data Record to Text Generation"☆149Updated 2 years ago
- XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning☆99Updated 3 years ago
- Hyperparameter Search for AllenNLP☆134Updated 4 years ago
- A coreference evaluation package for the CoNLL and ARRAU datasets☆40Updated 4 years ago
- ☆91Updated 8 months ago
- ☆77Updated 6 months ago
- SUPERT: Unsupervised multi-document summarization evaluation & generation☆91Updated last year
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆199Updated last year
- Question Answering and Generation for Summarization☆68Updated last year
- ☆41Updated 3 years ago
- Codebase, data and models for the Keep it Simple paper at ACL2021☆36Updated last year
- ☆73Updated 3 years ago
- Few-shot NLP benchmark for unified, rigorous eval☆91Updated 2 years ago
- This repository contains materials for the SIGIR 2022 tutorial on opinion summarization.☆34Updated 2 years ago
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆47Updated last year
- a tool for calcualting character n-gram F score☆67Updated last year
- ☆81Updated 2 years ago
- EMNLP DiscoEval paper☆42Updated 5 years ago
- Codebase for the Summary Loop paper at ACL2020☆44Updated last year
- ☆70Updated 3 years ago
- ☆57Updated last year
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆97Updated 2 years ago
- Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".☆59Updated 4 years ago
- Official code repository for "Exploring Neural Models for Query-Focused Summarization".☆48Updated last year
- Coreference resolution with different higher-order inference methods; implemented in PyTorch.☆35Updated last year