google-research-datasets / xsum_hallucination_annotationsLinks
Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (https://www.aclweb.org/anthology/2020.acl-main.173.pdf).
☆84Updated 4 years ago
Alternatives and similar repositories for xsum_hallucination_annotations
Users that are interested in xsum_hallucination_annotations are comparing it to the libraries listed below
Sorting:
- ☆59Updated 2 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆145Updated 2 years ago
- ☆44Updated 4 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆72Updated last week
- Dataset for NAACL 2021 paper: "DART: Open-Domain Structured Data Record to Text Generation"☆155Updated 2 years ago
- FRANK: Factuality Evaluation Benchmark☆59Updated 2 years ago
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆49Updated 2 years ago
- Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…☆50Updated 2 years ago
- XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning☆104Updated 4 years ago
- ☆46Updated 5 years ago
- ☆100Updated last year
- ☆58Updated 3 years ago
- This repo supports various cross-lingual transfer learning & multilingual NLP models.☆92Updated 2 years ago
- EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation☆98Updated 2 years ago
- Code and Models for the paper "End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering" (NeurIPS 20…☆109Updated 3 years ago
- ☆15Updated 4 years ago
- Heuristic Analysis for NLI Systems☆127Updated 4 years ago
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆99Updated 2 years ago
- An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"☆119Updated 3 years ago
- ☆39Updated 4 years ago
- Code for ACL 21: Generating Query Focused Summaries from Query-Free Resources☆33Updated 3 years ago
- ☆63Updated 2 years ago
- ☆50Updated 2 years ago
- Code and dataset for the EMNLP 2021 Finding paper "Can NLI Models Verify QA Systems’ Predictions?"☆25Updated 2 years ago
- Question Answering and Generation for Summarization☆71Updated 2 years ago
- ☆92Updated 4 years ago
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆66Updated 4 years ago
- MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance☆210Updated last year
- ☆28Updated 2 years ago
- Semantic parsers based on encoder-decoder framework☆91Updated 2 years ago