aetting / lm-diagnostics
Diagnostic tests for linguistic capacities in language models
☆66Updated 2 years ago
Alternatives and similar repositories for lm-diagnostics:
Users that are interested in lm-diagnostics are comparing it to the libraries listed below
- ☆38Updated 3 years ago
- Evaluating recurrent neural networks on predicting subject-verb agreement dependencies☆62Updated last year
- Data and code for Kang et al., EMNLP 2019's paper titled "(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Ann…☆29Updated 4 years ago
- ☆228Updated 3 years ago
- How Contextual are Contextualized Word Representations?☆41Updated 4 years ago
- Code for replicating the work in "Targeted Syntactic Evaluation of Language Models." EMNLP 2018.☆43Updated 4 years ago
- This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…☆19Updated 3 years ago
- Heuristic Analysis for NLI Systems☆125Updated 4 years ago
- End-to-end shallow discourse parser☆20Updated last year
- ☆31Updated 3 weeks ago
- A python package of common operations for AMRs☆28Updated 2 years ago
- Hyperparameter Search for AllenNLP☆134Updated last month
- The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit☆57Updated last year
- Perspectrum: a dataset of claims, perspectives and evidence documents☆33Updated 5 years ago
- ☆32Updated 3 years ago
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆25Updated 3 years ago
- UFSAC is a resource containing all WordNet Sense Annotated Corpora, and a Java library for manipulating them☆37Updated 2 years ago
- EMNLP DiscoEval paper☆42Updated 5 years ago
- Multi-Annotator Competence Estimation tool☆63Updated 5 years ago
- ☆58Updated last year
- ☆29Updated last year
- The library that uses dependency parsing to preprocess text to train DisSent model☆33Updated 4 years ago
- Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Framework☆52Updated 5 years ago
- Repository with code for MaChAmp: https://aclanthology.org/2021.eacl-demos.22/☆83Updated this week
- Discourse Based Evaluation of Language Understanding☆21Updated 2 years ago
- Evaluating Text Representations on Lexical Composition☆24Updated 5 years ago
- Code and data for paper Colorless Green Recurrent Networks Dream Hierarchically☆91Updated 3 years ago
- ACL 2020 Tutorial by Malihe Alikhani and Matthew Stone☆37Updated 4 years ago
- NLI test set with lexical inferences☆48Updated 6 years ago
- Repository for DISRPT2023 shared task☆17Updated 6 months ago