Alternatives and similar repositories for eraserbenchmark

Users that are interested in eraserbenchmark are comparing it to the libraries listed below

• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆84Updated 4 years ago
• tommccoy1 / hans
  Heuristic Analysis for NLI Systems
  ☆126Updated 4 years ago
• alontalmor / oLMpics
  ☆46Updated 5 years ago
• shreydesai / calibration
  Code and datasets for the EMNLP 2020 paper "Calibration of Pre-trained Transformers"
  ☆61Updated 2 years ago
• allenai / contrast-sets
  ☆59Updated 2 years ago
• Eric-Wallace / interpretability-tutorial-emnlp2020
  Materials for the EMNLP 2020 Tutorial on "Interpreting Predictions of NLP Models"
  ☆199Updated 4 years ago
• xhan77 / influence-function-analysis
  ☆63Updated 5 years ago
• allenai / flex
  Few-shot NLP benchmark for unified, rigorous eval
  ☆91Updated 3 years ago
• allenai / allentune
  Hyperparameter Search for AllenNLP
  ☆139Updated 4 months ago
• facebookresearch / QA-Overlap
  Code to support the paper "Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasets"
  ☆66Updated 3 years ago
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆144Updated 2 years ago
• shmsw25 / bart-closed-book-qa
  A BART version of an open-domain QA model in a closed-book setup
  ☆119Updated 4 years ago
• ThomasScialom / QuestEval
  ☆99Updated last year
• nicola-decao / diffmask
  Pytorch implementation of DiffMask
  ☆57Updated 2 years ago
• yg211 / summary-reward-no-reference
  A reference-free metric for measuring summary quality, learned from human ratings.
  ☆43Updated 2 years ago
• Yale-LILY / dart
  Dataset for NAACL 2021 paper: "DART: Open-Domain Structured Data Record to Text Generation"
  ☆155Updated 2 years ago
• yanaiela / amnesic_probing
  ☆39Updated 4 years ago
• easonnie / ChaosNLI
  [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data
  ☆38Updated 3 years ago
• eaclark07 / sms
  ☆44Updated 6 years ago
• cambridgeltl / xcopa
  XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning
  ☆103Updated 4 years ago
• ewsheng / nlg-bias
  Dataset + classifier tools to study social perception biases in natural language generation
  ☆70Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• shauli-ravfogel / nullspace_projection
  ☆89Updated 3 years ago
• successar / FRESH
  ☆27Updated 2 years ago
• jacobandreas / geca
  ☆42Updated 4 years ago
• copenlu / xai-benchmark
  A Diagnostic Study of Explainability Techniques for Text Classification
  ☆68Updated 4 years ago
• neulab / REALSumm
  REALSumm: Re-evaluating Evaluation in Text Summarization
  ☆71Updated 2 years ago
• tuvuumass / task-transferability
  Data and code for our paper "Exploring and Predicting Transferability across NLP Tasks", to appear at EMNLP 2020.
  ☆50Updated 4 years ago
• jzbjyb / LPAQA
  Language model Prompt And Query Archive
  ☆158Updated 4 years ago
• shmsw25 / AmbigQA
  An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"
  ☆119Updated 3 years ago