aetting / lm-diagnostics
Diagnostic tests for linguistic capacities in language models
☆66Updated 2 years ago
Alternatives and similar repositories for lm-diagnostics:
Users that are interested in lm-diagnostics are comparing it to the libraries listed below
- This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…☆19Updated 3 years ago
- ☆29Updated last year
- How Contextual are Contextualized Word Representations?☆41Updated 4 years ago
- EMNLP DiscoEval paper☆43Updated 5 years ago
- Data and code for Kang et al., EMNLP 2019's paper titled "(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Ann…☆29Updated 5 years ago
- ☆31Updated 2 months ago
- ☆229Updated 4 years ago
- A python package of common operations for AMRs☆29Updated 2 years ago
- The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit☆57Updated last year
- ☆39Updated 3 years ago
- End-to-end shallow discourse parser☆20Updated last year
- Evaluating recurrent neural networks on predicting subject-verb agreement dependencies☆62Updated 2 years ago
- XCOPA: A Multilingual Dataset for Causal Commonsense Reasoning☆102Updated 4 years ago
- The Benchmark of Linguistic Minimal Pairs☆150Updated 2 years ago
- Various utility scripts useful for natural language processing, machine translation, etc.☆48Updated 2 years ago
- Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".☆35Updated 3 years ago
- A resource to create a multi domain Dialog Act Tagger for conversational agents using publicly available data☆51Updated 3 years ago
- Organized inventory of research using the Abstract Meaning Representation☆37Updated this week
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆86Updated this week
- Hyperparameter Search for AllenNLP☆139Updated last month
- ☆32Updated 3 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆71Updated 2 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆81Updated 4 years ago
- [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data☆36Updated 3 years ago
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆96Updated 2 years ago
- This repo supports various cross-lingual transfer learning & multilingual NLP models.☆92Updated last year
- ☆59Updated last year
- A program to choose transfer languages for cross-lingual learning☆72Updated last year
- ACL 2020 Tutorial by Malihe Alikhani and Matthew Stone☆37Updated 4 years ago
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆27Updated 3 years ago