aalok-sathe / surprisalLinks
A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models.
☆40Updated 6 months ago
Alternatives and similar repositories for surprisal
Users that are interested in surprisal are comparing it to the libraries listed below
Sorting:
- A framework for nonlinear continuous-time regression☆36Updated 5 months ago
- Tools for calculating psycholinguistically-relevant metrics of language statistics using transformer language models☆11Updated 2 years ago
- Utility for behavioral and representational analyses of Language Models☆148Updated last week
- [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring☆10Updated last year
- A psycholinguistic modeling toolkit☆28Updated last month
- ☆20Updated 3 years ago
- Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"☆14Updated 2 years ago
- Collection of available data sources for cognitively-inspired NLP☆38Updated 4 years ago
- ☆11Updated last month
- Corpus of naturalistic stories with annotation and psycholinguistic measures☆57Updated last month
- This repository contains the Potsdam Textbook Corpus (PoTeC) which is a natural reading eye-tracking corpus.☆11Updated last week
- Analysis pipeline for Revisiting UID (EMNLP 2021)☆11Updated 2 years ago
- SAP Benchmark☆18Updated 9 months ago
- A neural language model that estimates incremental processing complexity☆39Updated 3 years ago
- Narratives: fMRI data for evaluating models of naturalistic language comprehension☆61Updated 3 months ago
- ☆58Updated 4 years ago
- Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…☆16Updated last year
- Code for auto-generating maze distractors and running maze in ibex☆23Updated 3 weeks ago
- Structural Supervision & Human Psycholinguistic Data☆11Updated 4 years ago
- Natural Language Processing Research in North American Linguistics Departments☆21Updated 3 months ago
- Automatically exported from code.google.com/p/incremental-top-down-parser☆13Updated 10 years ago
- An initiative to collect and distribute resources for co-reference resolution in a unified standard.☆25Updated last year
- CogniVal: cognitive word embedding evaluation☆15Updated 2 years ago
- Python version for Doug Biber's Multidimensional Analysis (MDA)☆32Updated 3 months ago
- Contextualised Word Representations for Lexical Semantic Change Analysis☆31Updated 4 years ago
- Cross-Linguistic Norms, Ratings, and Relations for Words and Concepts☆16Updated this week
- Code associated with the paper "Inducing brain-relevant bias in natural language processing models" in the proceedings of the 33rd Confer…☆12Updated 5 years ago
- Tools for all things related to Combinatory Categorial Grammar☆15Updated last year
- [PNAS'21] The neural architecture of language: Integrative modeling converges on predictive processing☆63Updated last year
- ☆10Updated last year