Alternatives and similar repositories for contrast-sets

Users that are interested in contrast-sets are comparing it to the libraries listed below

• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆82Updated 4 years ago
• neulab / REALSumm
  REALSumm: Re-evaluating Evaluation in Text Summarization
  ☆71Updated 2 years ago
• alontalmor / oLMpics
  ☆46Updated 5 years ago
• tommccoy1 / hans
  Heuristic Analysis for NLI Systems
  ☆126Updated 4 years ago
• facebookresearch / QA-Overlap
  Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"
  ☆66Updated 3 years ago
• berlino / tensor2struct-public
  Semantic parsers based on encoder-decoder framework
  ☆91Updated 2 years ago
• easonnie / ChaosNLI
  [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data
  ☆37Updated 3 years ago
• shreydesai / calibration
  Code and datasets for the EMNLP 2020 paper "Calibration of Pre-trained Transformers"
  ☆61Updated 2 years ago
• eaclark07 / sms
  ☆43Updated 5 years ago
• jifan-chen / QA-Verification-Via-NLI
  Code and dataset for the EMNLP 2021 Finding paper "Can NLI Models Verify QA Systems’ Predictions?"
  ☆25Updated last year
• shtoshni / span-rep
  Code for Repl4NLP paper "A Cross-Task Analysis of Text Span Representations"
  ☆21Updated 2 years ago
• ZeweiChu / DiscoEval
  EMNLP DiscoEval paper
  ☆43Updated 5 years ago
• tagoyal / dae-factuality
  ☆27Updated 2 years ago
• jacobandreas / geca
  ☆42Updated 4 years ago
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆144Updated 2 years ago
• allenai / flex
  Few-shot NLP benchmark for unified, rigorous eval
  ☆91Updated 3 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• qkaren / unsup_gen_for_cms_reasoning
  ☆49Updated 2 years ago
• tagoyal / sow-reap-paraphrasing
  Contains data/code for the paper "Neural Syntactic Preordering for Controlled Paraphrase Generation" (ACL 2020).
  ☆76Updated 11 months ago
• AkariAsai / XORQA
  This is the official repository for NAACL 2021, "XOR QA: Cross-lingual Open-Retrieval Question Answering".
  ☆79Updated 4 years ago
• cambridgeltl / xcopa
  XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning
  ☆103Updated 4 years ago
• jayded / eraserbenchmark
  A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/
  ☆96Updated 2 years ago
• Yale-LILY / dart
  Dataset for NAACL 2021 paper: "DART: Open-Domain Structured Data Record to Text Generation"
  ☆154Updated 2 years ago
• thespectrewithin / joint_align
  Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework
  ☆52Updated 5 years ago
• esdurmus / feqa
  Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)
  ☆48Updated 2 years ago
• stangelid / qt
  ☆44Updated 4 years ago
• qkaren / Counterfactual-StoryRW
  code and data for EMNLP-19 paper "Counterfactual Story Reasoning and Generation" https://arxiv.org/abs/1909.04076
  ☆101Updated 5 years ago
• vid-koci / bert-commonsense
  Code for papers "A Surprisingly Robust Trick for Winograd Schema Challenge" and "WikiCREM: A Large Unsupervised Corpus for Coreference Re…
  ☆71Updated 2 years ago
• OanaMariaCamburu / e-SNLI
  ☆163Updated 3 years ago
• yumoxu / marge
  Code for ACL 21: Generating Query Focused Summaries from Query-Free Resources
  ☆33Updated 3 years ago