aalok-sathe / surprisal
A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models.
☆35Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for surprisal
- Tools for calculating psycholinguistically-relevant metrics of language statistics using transformer language models☆9Updated 2 years ago
- A framework for nonlinear continuous-time regression☆30Updated 6 months ago
- Utility for behavioral and representational analyses of Language Models☆122Updated this week
- ☆16Updated 2 years ago
- A psycholinguistic modeling toolkit☆24Updated 2 weeks ago
- A neural language model that estimates incremental processing complexity☆39Updated 3 years ago
- ☆57Updated 4 years ago
- Collection of available data sources for cognitively-inspired NLP☆36Updated 4 years ago
- Analysis pipeline for Revisiting UID (EMNLP 2021)☆10Updated 2 years ago
- Narratives: fMRI data for evaluating models of naturalistic language comprehension☆58Updated 3 years ago
- Corpus of naturalistic stories with annotation and psycholinguistic measures☆50Updated 3 years ago
- Automatically exported from code.google.com/p/incremental-top-down-parser☆13Updated 9 years ago
- ☆17Updated 10 months ago
- ☆30Updated 3 months ago
- Code for auto-generating maze distractors and running maze in ibex☆22Updated 4 months ago
- Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"☆12Updated 2 years ago
- Modern SQLAlchemy wrappers for the MRC psycholinguistics database☆20Updated 10 years ago
- Cross-Linguistic Norms, Ratings, and Relations for Words and Concepts☆15Updated this week
- Predicting brain activity from word embeddings during natural language comprehension☆18Updated 9 months ago
- Code associated with the paper "Inducing brain-relevant bias in natural language processing models" in the proceedings of the 33rd Confer…☆13Updated 5 years ago
- Scaffold for NLP researcher to quickly set up the codebase☆17Updated 6 months ago
- CogniVal: cognitive word embedding evaluation☆14Updated last year
- SAP Benchmark☆13Updated 2 months ago
- ☆18Updated 2 years ago
- Natural Language Processing Research in North American Linguistics Departments☆18Updated 2 weeks ago
- Python version for Doug Biber's Multidimensional Analysis (MDA)☆27Updated 5 months ago
- Repository for the Stanford Emotional Narratives Dataset☆28Updated last year
- Diagnostic tests for linguistic capacities in language models☆66Updated 2 years ago
- Contextualised Word Representations for Lexical Semantic Change Analysis☆31Updated 4 years ago
- Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…☆10Updated 8 months ago