aetting / lm-diagnosticsLinks
Diagnostic tests for linguistic capacities in language models
☆66Updated 3 years ago
Alternatives and similar repositories for lm-diagnostics
Users that are interested in lm-diagnostics are comparing it to the libraries listed below
Sorting:
- ☆230Updated 4 years ago
- The Benchmark of Linguistic Minimal Pairs☆152Updated 2 years ago
- ☆39Updated 4 years ago
- Heuristic Analysis for NLI Systems☆126Updated 4 years ago
- ☆59Updated 2 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆144Updated 2 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Updated 4 years ago
- How Contextual are Contextualized Word Representations?☆41Updated 5 years ago
- End-to-end shallow discourse parser☆21Updated 2 years ago
- Data and code for Kang et al., EMNLP 2019's paper titled "(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Ann…☆29Updated 5 years ago
- Evaluating Text Representations on Lexical Composition☆24Updated 5 years ago
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆97Updated 2 years ago
- Materials for the EMNLP 2020 Tutorial on "Interpreting Predictions of NLP Models"☆199Updated 4 years ago
- Language Modelling Makes Sense - WSD (and more) with Contextual Embeddings☆95Updated 2 years ago
- This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…☆19Updated 3 years ago
- Lexical Substitution Framework☆46Updated 2 years ago
- The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit☆57Updated this week
- Evaluating recurrent neural networks on predicting subject-verb agreement dependencies☆63Updated 2 years ago
- ☆164Updated 3 years ago
- ☆33Updated 6 months ago
- Cross-Lingual Alignment of Contextual Word Embeddings☆99Updated 5 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆71Updated 2 years ago
- This is the Grammarly's Yahoo Answers Formality Corpus☆107Updated 3 weeks ago
- Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework☆52Updated 5 years ago
- This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs☆182Updated last year
- Perspectrum: a dataset of claims, perspectives and evidence documents☆34Updated 5 years ago
- Assessing syntactic abilities of BERT☆149Updated 6 years ago
- XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning☆103Updated 4 years ago
- A program to choose transfer languages for cross-lingual learning☆72Updated 2 years ago
- Conversion scripts for coreference☆27Updated 10 months ago