jennhu / lm-pragmatics
Code and data for "A fine-grained comparison of pragmatic language understanding in humans and language models"
☆10Updated 2 years ago
Alternatives and similar repositories for lm-pragmatics:
Users that are interested in lm-pragmatics are comparing it to the libraries listed below
- [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring☆10Updated last year
- Evaluating recurrent neural networks on predicting subject-verb agreement dependencies☆62Updated 2 years ago
- This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…☆19Updated 3 years ago
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆27Updated 3 years ago
- Diagnostic tests for linguistic capacities in language models☆66Updated 2 years ago
- A simple library for querying the URIEL typological database.☆89Updated last year
- ☆59Updated 2 years ago
- a tool for calcualting character n-gram F score☆72Updated 2 years ago
- ☆89Updated 2 years ago
- ☆27Updated 4 months ago
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆14Updated 5 months ago
- ☆10Updated last year
- ☆84Updated 7 months ago
- ☆51Updated 3 years ago
- Codebase describing experiments in Truncation Sampling as Language Model Desmoothing☆11Updated 2 years ago
- ☆14Updated 4 years ago
- Code for the ACL 2021 paper "Structural Guidance for Transformer Language Models"☆13Updated 2 years ago
- Utility for behavioral and representational analyses of Language Models☆138Updated this week
- ☆48Updated 2 years ago
- ☆19Updated last year
- ☆58Updated 2 years ago
- ☆9Updated 2 years ago
- ☆39Updated 3 years ago
- The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit☆57Updated last year
- Analysis pipeline for Revisiting UID (EMNLP 2021)☆11Updated 2 years ago
- Data and code for Kang et al., EMNLP 2019's paper titled "(Male, Bachelor) and (Female, Ph.D) have different connotations: Parallelly Ann…☆29Updated 5 years ago
- Data and code repository of " Multilingual Fairness Evaluation for Hate Speech Detection ". LREC 2020.☆20Updated 2 years ago
- UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…☆31Updated 2 years ago
- ☆229Updated 4 years ago
- ☆10Updated 2 years ago