A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models.
☆53Oct 19, 2026Updated last week
Alternatives and similar repositories for surprisal
Users that are interested in surprisal are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tools for calculating psycholinguistically-relevant metrics of language statistics using transformer language models☆13Nov 11, 2022Updated 3 years ago
- SAP Benchmark☆29Sep 18, 2024Updated 2 years ago
- Utility for behavioral and representational analyses of Language Models☆196Oct 6, 2026Updated 3 weeks ago
- Simple tool for generating tokens with open source transformers and/or calculate per-token surprisal.☆15Jul 10, 2026Updated 3 months ago
- A framework for nonlinear continuous-time regression☆42Jan 22, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring☆13Dec 1, 2023Updated 2 years ago
- Tools for all things related to Combinatory Categorial Grammar☆20Jul 12, 2025Updated last year
- Simulation tools for Mixed Models☆21Jun 22, 2026Updated 4 months ago
- source code of NAACL2021 "PCFGs Can Do Better: Inducing Probabilistic Context-Free Grammars with Many Symbols“ and ACL2021 main conferenc…☆52Mar 28, 2025Updated last year
- This repository contains the Potsdam Textbook Corpus (PoTeC) which is a natural reading eye-tracking corpus.☆16Jul 20, 2026Updated 3 months ago
- Easy black-box access to state-of-the-art language models☆15Jun 7, 2023Updated 3 years ago
- ☆16Oct 23, 2023Updated 3 years ago
- Code for replicating the work in "Targeted Syntactic Evaluation of Language Models." EMNLP 2018.☆45Apr 25, 2020Updated 6 years ago
- Official Implementation of ACL2023: Unsupervised Discontinuous Constituency Parsing with Mildly Context-Sensitive Grammars☆13May 24, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆87Oct 21, 2026Updated last week
- EWoK dataset generation framework☆14May 14, 2024Updated 2 years ago
- ☆24Apr 14, 2025Updated last year
- Matlab and Python code for pupillometry studies.☆14May 27, 2021Updated 5 years ago
- Convert speech to sine waves. Website and Python library☆16Dec 28, 2024Updated last year
- A repository containing links to useful phonological software☆12Feb 16, 2023Updated 3 years ago
- A Python package to calculate the delay between two arrays or two audio files☆10Aug 28, 2025Updated last year
- ☆202Sep 22, 2026Updated last month
- A json Dataset with 25696 kpop songs. (2000 ~ 2023)☆11Dec 3, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Inside-Outside PCFG Training Tool☆12Mar 29, 2016Updated 10 years ago
- Hierarchical Universal Modular ANotator☆12Updated this week
- experiment, data, and analysis code for "Characterizing the dynamics of learning in repeated reference games"☆12Dec 10, 2022Updated 3 years ago
- UArizona DataLab Workshops☆10Aug 8, 2025Updated last year
- Depth-Bounded PCFG Induction☆13Apr 19, 2019Updated 7 years ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆15Aug 27, 2024Updated 2 years ago
- Measure the similarity of text corpora for 74 languages☆14Jan 26, 2024Updated 2 years ago
- Word embeddings from PPMI-weighted and dirichlet-smoothed co-occurrence matrices☆10Aug 3, 2020Updated 6 years ago
- Code for the paper "Implicit Representations of Meaning in Neural Language Models"☆58Feb 14, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A corpus of short answers written by learners of English and graded with CEFR levels☆13Dec 17, 2021Updated 4 years ago
- Code for running forward and backward versions of GPT2☆10Nov 20, 2021Updated 4 years ago
- Materials for MNE tutorials at Practical MEEG workshop Paris 2019☆16Dec 4, 2019Updated 6 years ago
- Identifying the language of input text using character-level n-grams, with support for 45 languages☆11Dec 26, 2022Updated 3 years ago
- 📃Language Model based sentences scoring library☆312Jun 8, 2026Updated 4 months ago
- EEG/MEG data preprocessing and analyses framework☆13May 2, 2022Updated 4 years ago
- Code to compute a word's probability using the fixes from "How to Compute the Probability of a Word"☆12Oct 14, 2024Updated 2 years ago