Alternatives and similar repositories for contrast-sets

Users that are interested in contrast-sets are comparing it to the libraries listed below

• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆82Updated 4 years ago
• neulab / REALSumm
  REALSumm: Re-evaluating Evaluation in Text Summarization
  ☆71Updated 2 years ago
• jifan-chen / QA-Verification-Via-NLI
  Code and dataset for the EMNLP 2021 Finding paper "Can NLI Models Verify QA Systems’ Predictions?"
  ☆25Updated last year
• tagoyal / dae-factuality
  ☆27Updated 2 years ago
• alontalmor / oLMpics
  ☆46Updated 5 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• morningmoni / EDE
  Code for paper "Extract, Denoise and Enforce: Evaluating and Improving Concept Preservation for Text-to-Text Generation" EMNLP 2021 and "…
  ☆18Updated 3 years ago
• allenai / flex
  Few-shot NLP benchmark for unified, rigorous eval
  ☆91Updated 2 years ago
• yanaiela / amnesic_probing
  ☆39Updated 4 years ago
• AkariAsai / XORQA
  This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".
  ☆79Updated 4 years ago
• jacobandreas / geca
  ☆42Updated 4 years ago
• easonnie / ChaosNLI
  [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data
  ☆36Updated 3 years ago
• facebookresearch / reconsider
  ReConsider is a re-ranking model that re-ranks the top-K (passage, answer-span) predictions of an Open-Domain QA Model like DPR (Karpukhi…
  ☆49Updated 4 years ago
• bhargaviparanjape / explainable_qa
  Implementation for https://arxiv.org/abs/2005.00652
  ☆28Updated 2 years ago
• facebookresearch / QA-Overlap
  Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"
  ☆66Updated 3 years ago
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆56Updated 2 years ago
• esdurmus / feqa
  Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)
  ☆48Updated 2 years ago
• yz-joey / ACLPUB
  The official tool for creating proceedings for conferences of the Association for Computational Linguistics (ACL).
  ☆41Updated 4 years ago
• yumoxu / marge
  Code for ACL 21: Generating Query Focused Summaries from Query-Free Resources
  ☆33Updated 2 years ago
• ZeweiChu / DiscoEval
  EMNLP DiscoEval paper
  ☆43Updated 5 years ago
• tommccoy1 / hans
  Heuristic Analysis for NLI Systems
  ☆125Updated 4 years ago
• tomerwolgithub / Break
  ☆46Updated 2 years ago
• AkariAsai / unanswerable_qa
  The official implementation for ACL 2021 "Challenges in Information Seeking QA: Unanswerable Questions and Paragraph Retrieval".
  ☆27Updated 4 years ago
• Shikib / usr
  Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…
  ☆50Updated 2 years ago
• shuningjin / discrete-text-rep
  ☆25Updated 3 years ago
• cambridgeltl / xcopa
  XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning
  ☆103Updated 4 years ago
• wilburOne / cosmosqa
  ☆64Updated 2 years ago
• xwhan / ProQA
  Progressively Pretrained Dense Corpus Index for Open-Domain QA and Information Retrieval
  ☆43Updated 2 years ago
• stangelid / qt
  ☆44Updated 3 years ago
• orhonovich / q-squared
  ☆29Updated 3 years ago