aalok-sathe / surprisalLinks
A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models.
☆45Updated 4 months ago
Alternatives and similar repositories for surprisal
Users that are interested in surprisal are comparing it to the libraries listed below
Sorting:
- Tools for calculating psycholinguistically-relevant metrics of language statistics using transformer language models☆12Updated 3 years ago
- A framework for nonlinear continuous-time regression☆38Updated 11 months ago
- Utility for behavioral and representational analyses of Language Models☆172Updated last week
- Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"☆14Updated 3 years ago
- [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring☆10Updated 2 years ago
- This repository contains the Potsdam Textbook Corpus (PoTeC) which is a natural reading eye-tracking corpus.☆14Updated last week
- ☆15Updated last month
- A neural language model that estimates incremental processing complexity☆39Updated 4 years ago
- A psycholinguistic modeling toolkit☆30Updated 3 weeks ago
- Collection of available data sources for cognitively-inspired NLP☆38Updated 5 years ago
- ☆21Updated 3 years ago
- Corpus of naturalistic stories with annotation and psycholinguistic measures☆59Updated 7 months ago
- Narratives: fMRI data for evaluating models of naturalistic language comprehension☆67Updated 9 months ago
- ☆59Updated 5 years ago
- Code and data from semantic feature generation with GPT-3☆18Updated 2 years ago
- Analysis pipeline for Revisiting UID (EMNLP 2021)☆12Updated 3 years ago
- Code and data for "A fine-grained comparison of pragmatic language understanding in humans and language models"☆11Updated 3 years ago
- Automated Semantic Analysis of Discourse Markers☆10Updated 3 years ago
- SAP Benchmark☆24Updated last year
- Psycholinguistic experiments online☆57Updated 4 years ago
- Structural Supervision & Human Psycholinguistic Data☆12Updated 4 years ago
- ☆12Updated 3 years ago
- Repository for the "Computational Cognitive Modeling and Linguistic Theory" (Brasoveanu & Dotlacil 2020) book☆48Updated 4 years ago
- Diagnostic tests for linguistic capacities in language models☆65Updated 3 years ago
- ☆40Updated last year
- Python version for Doug Biber's Multidimensional Analysis (MDA)☆38Updated last month
- CogniVal: cognitive word embedding evaluation☆16Updated 3 years ago
- Code for processing brain data☆12Updated 6 years ago
- English Small World of Words SWOWEN-2018☆73Updated 3 years ago
- Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…☆20Updated last year