Alternatives and similar repositories for lm-diagnostics

Users that are interested in lm-diagnostics are comparing it to the libraries listed below

• yanaiela / amnesic_probing
  ☆39Updated 4 years ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆82Updated 4 years ago
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆144Updated 2 years ago
• rtmdrr / testSignificanceNLP
  ☆230Updated 4 years ago
• facebookresearch / Imppres
  This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…
  ☆19Updated 3 years ago
• berzak / onestop-qa
  ☆25Updated last year
• rycolab / aclpub2
  ☆33Updated 5 months ago
• neulab / REALSumm
  REALSumm: Re-evaluating Evaluation in Text Summarization
  ☆71Updated 2 years ago
• dykang / PASTEL
  Data and code for Kang et al., EMNLP 2019's paper titled "(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Ann…
  ☆29Updated 5 years ago
• alexwarstadt / blimp
  The Benchmark of Linguistic Minimal Pairs
  ☆151Updated 2 years ago
• neulab / langrank
  A program to choose transfer languages for cross-lingual learning
  ☆72Updated 2 years ago
• BeckyMarvin / LM_syneval
  Code for replicating the work in "Targeted Syntactic Evaluation of Language Models." EMNLP 2018.
  ☆43Updated 5 years ago
• decompositional-semantics-initiative / decomp
  The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit
  ☆57Updated 2 years ago
• ablodge / amr-utils
  A python package of common operations for AMRs
  ☆29Updated 3 years ago
• YueDongCS / EditNTS
  This repo contains the code for our paper "EditNTS: An Neural Programmer-Interpreter Model for Sentence Simplification through Explicit E…
  ☆58Updated 5 years ago
• tommccoy1 / hans
  Heuristic Analysis for NLI Systems
  ☆125Updated 4 years ago
• ColingPaper2018 / DialogueAct-Tagger
  A resource to create a multi domain Dialog Act Tagger for conversational agents using publicly available data
  ☆51Updated 3 years ago
• cambridgeltl / xcopa
  XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning
  ☆103Updated 4 years ago
• allenanie / DisExtract
  The library that uses dependency parsing to preprocess text to train DisSent model
  ☆33Updated 5 years ago
• CogComp / perspectrum
  Perspectrum: a dataset of claims, perspectives and evidence documents
  ☆34Updated 5 years ago
• ns-moosavi / coval
  A coreference evaluation package for the CoNLL and ARRAU datasets
  ☆40Updated 4 years ago
• machamp-nlp / machamp
  Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/
  ☆87Updated last month
• alexwarstadt / data_generation
  ☆29Updated last year
• bkntr / coref-ee
  Coreference Resolution With Entity Equalization
  ☆41Updated 2 years ago
• CannyLab / summary_loop
  Codebase for the Summary Loop paper at ACL2020
  ☆45Updated 2 years ago
• shuningjin / discrete-text-rep
  ☆25Updated 3 years ago
• cpllab / syntactic-generalization
  Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"
  ☆28Updated 4 years ago
• dirkhovy / MACE
  Multi-Annotator Competence Estimation tool
  ☆63Updated 5 years ago
• jayded / eraserbenchmark
  A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/
  ☆96Updated 2 years ago
• PKU-TANGENT / NeuralEDUSeg
  A toolkit for discourse segmentation (EDU segmentation).
  ☆101Updated 2 years ago