allenai / contrast-sets
☆59Updated last year
Alternatives and similar repositories for contrast-sets:
Users that are interested in contrast-sets are comparing it to the libraries listed below
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆81Updated 4 years ago
- ☆58Updated 2 years ago
- Code and dataset for the EMNLP 2021 Finding paper "Can NLI Models Verify QA Systems’ Predictions?"☆25Updated last year
- ☆46Updated 5 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆71Updated 2 years ago
- Heuristic Analysis for NLI Systems☆125Updated 4 years ago
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆48Updated last year
- ☆27Updated 2 years ago
- ☆42Updated 4 years ago
- FRANK: Factuality Evaluation Benchmark☆54Updated 2 years ago
- Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".☆58Updated 4 years ago
- Few-shot NLP benchmark for unified, rigorous eval☆91Updated 2 years ago
- EMNLP DiscoEval paper☆42Updated 5 years ago
- [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data☆36Updated 2 years ago
- ☆43Updated 3 years ago
- The official implementation of ACL 2020, "Logic-Guided Data Augmentation and Regularization for Consistent Question Answering".☆71Updated 7 months ago
- ☆45Updated 2 years ago
- A reference-free metric for measuring summary quality, learned from human ratings.☆42Updated 2 years ago
- Semantic parsers based on encoder-decoder framework☆91Updated 2 years ago
- ☆49Updated last year
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆14Updated 4 months ago
- Code for Repl4NLP paper "A Cross-Task Analysis of Text Span Representations"☆21Updated 2 years ago
- Codebase for the Summary Loop paper at ACL2020☆44Updated last year
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆140Updated 2 years ago
- This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".☆79Updated 3 years ago
- ☆25Updated 2 years ago
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆96Updated 2 years ago
- Code Repo for the ACL21 paper "Common Sense Beyond English: Evaluating and Improving Multilingual LMs for Commonsense Reasoning"☆22Updated 3 years ago
- Repository for the code associated with the paper: Unsupervised Extractive Summarization using Mutual Information☆25Updated 3 years ago
- Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"☆66Updated 3 years ago