aetting / lm-diagnosticsLinks
Diagnostic tests for linguistic capacities in language models
☆65Updated 3 years ago
Alternatives and similar repositories for lm-diagnostics
Users that are interested in lm-diagnostics are comparing it to the libraries listed below
Sorting:
- ☆230Updated 4 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆148Updated 3 years ago
- ☆59Updated 2 years ago
- Heuristic Analysis for NLI Systems☆128Updated 4 years ago
- Materials for the EMNLP 2020 Tutorial on "Interpreting Predictions of NLP Models"☆200Updated 5 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Updated 5 years ago
- ☆39Updated 4 years ago
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆101Updated 3 years ago
- ☆33Updated 4 months ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆73Updated 3 months ago
- Evaluating Text Representations on Lexical Composition☆24Updated 6 years ago
- How Contextual are Contextualized Word Representations?☆43Updated 5 years ago
- The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit☆59Updated 5 months ago
- ☆166Updated 3 years ago
- The Benchmark of Linguistic Minimal Pairs☆160Updated 3 years ago
- XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning☆104Updated 4 years ago
- Data and code for Kang et al., EMNLP 2019's paper titled "(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Ann…☆30Updated 5 years ago
- Evaluating recurrent neural networks on predicting subject-verb agreement dependencies☆63Updated 2 years ago
- This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs☆187Updated 2 years ago
- This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…☆19Updated 4 years ago
- A python package of common operations for AMRs☆29Updated 3 years ago
- The library that uses dependency parsing to preprocess text to train DisSent model☆32Updated 5 years ago
- A coreference evaluation package for the CoNLL and ARRAU datasets☆41Updated 5 years ago
- ☆32Updated 4 years ago
- Various utility scripts useful for natural language processing, machine translation, etc.☆50Updated 3 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆90Updated 7 months ago
- This repo supports various cross-lingual transfer learning & multilingual NLP models.☆92Updated 2 years ago
- Multi-Annotator Competence Estimation tool☆66Updated 6 years ago
- Official code of our NAACL 2019 paper on Zero-Shot Cross-Lingual Transfer with Order Differences☆18Updated 6 years ago
- EMNLP DiscoEval paper☆43Updated 6 years ago