carina-kauf / better-mlm-scoring
[Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring
☆11Updated last year
Alternatives and similar repositories for better-mlm-scoring:
Users that are interested in better-mlm-scoring are comparing it to the libraries listed below
- Utility for behavioral and representational analyses of Language Models☆132Updated 2 weeks ago
- A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models…☆37Updated 3 months ago
- A psycholinguistic modeling toolkit☆26Updated 3 weeks ago
- Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"☆15Updated 2 years ago
- A neural language model that estimates incremental processing complexity☆39Updated 3 years ago
- Analysis pipeline for Revisiting UID (EMNLP 2021)☆11Updated 2 years ago
- Diagnostic tests for linguistic capacities in language models☆66Updated 2 years ago
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆26Updated 3 years ago
- ☆22Updated 3 years ago
- ☆12Updated 2 years ago
- This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…☆19Updated 3 years ago
- A simple library for querying the URIEL typological database.☆88Updated 11 months ago
- The Benchmark of Linguistic Minimal Pairs☆149Updated 2 years ago
- Automated Semantic Analysis of Discourse Markers☆10Updated 2 years ago
- Evaluating recurrent neural networks on predicting subject-verb agreement dependencies☆62Updated 2 years ago
- Contextualised Word Representations for Lexical Semantic Change Analysis☆31Updated 4 years ago
- Code and data for "A fine-grained comparison of pragmatic language understanding in humans and language models"☆10Updated 2 years ago
- SAP Benchmark☆15Updated 6 months ago
- ☆16Updated 3 years ago
- Corpus of naturalistic stories with annotation and psycholinguistic measures☆52Updated 3 years ago
- An initiative to collect and distribute resources for co-reference resolution in a unified standard.☆24Updated 10 months ago
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tran…☆17Updated 2 years ago
- Python API for loading language data from American-English CHILDES database☆15Updated 2 years ago
- Repository for DISRPT2023 shared task☆17Updated 8 months ago
- ☆59Updated 2 years ago
- ☆39Updated 3 years ago
- Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…☆13Updated last year
- Scaffold for NLP researcher to quickly set up the codebase☆17Updated this week
- UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…☆30Updated 2 years ago
- Data Sets and Models for Evaluation of Lexical Semantic Change Detection☆28Updated 2 years ago