Simple tool for generating tokens with open source transformers and/or calculate per-token surprisal.
☆15Jul 10, 2026Updated 3 months ago
Alternatives and similar repositories for llm_surprisal
Users that are interested in llm_surprisal are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code for auto-generating maze distractors and running maze in ibex☆25Sep 22, 2026Updated last month
- An R package for estimating the log-probabilities of words in a given context using transformer models.☆13Jun 30, 2026Updated 4 months ago
- Sentence Gestalt model code and modeling outputs (Rabovsky, Hansen, & McClelland, NHB, 2018)☆11Jul 10, 2018Updated 8 years ago
- This repository contains the Potsdam Textbook Corpus (PoTeC) which is a natural reading eye-tracking corpus.☆16Oct 30, 2026Updated last week
- SAP Benchmark☆30Sep 18, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Online materials for Social Media Data Analysis at the University of Konstanz☆10Oct 13, 2025Updated last year
- A package for manipulating EEG data in R.☆28Sep 28, 2026Updated last month
- LinPipe: Multilingual Processing Tool☆11Updated this week
- Matlab and Python code for pupillometry studies.☆14May 27, 2021Updated 5 years ago
- A repository containing links to useful phonological software☆12Feb 16, 2023Updated 3 years ago
- A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models…☆53Oct 19, 2026Updated 2 weeks ago
- Datasets and models included in the book "Introduction to Bayesian Data Analysis for Cognitive Science".☆18Apr 21, 2026Updated 6 months ago
- This repository contains all the materials for my "Python Programming for Linguists" workshop. This is a Python workshop for beginners wi…☆42Jan 8, 2023Updated 3 years ago
- LLM-only topic extraction and classification☆11Jun 3, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tools for calculating psycholinguistically-relevant metrics of language statistics using transformer language models☆13Nov 11, 2022Updated 3 years ago
- Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization [ACL 2026]☆20Apr 18, 2026Updated 6 months ago
- ☆17Jul 11, 2026Updated 3 months ago
- Lecture notes from a statistics course I teach at Potsdam☆30Sep 9, 2020Updated 6 years ago
- This is the repository for our work titled 'DataNarrative: Automated Data-Driven Storytelling with Visualizations and Texts'☆13Apr 24, 2025Updated last year
- ☆10May 11, 2024Updated 2 years ago
- decidables: Explorable Explanations of Decision Making☆11Jun 28, 2026Updated 4 months ago
- SP-10K is a large-scale human-annotated selectional preference set. Five selectional preference relations are included.☆12May 6, 2020Updated 6 years ago
- Data sets from subject/item type studies in Psychology and Linguistics☆57Sep 16, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Functions for reading and pre-processing eye tracking data.☆15Jul 26, 2022Updated 4 years ago
- Cross-platform working memory span task☆47Nov 6, 2024Updated 2 years ago
- Semantically Search Emojis From the Command Line!☆13Nov 26, 2023Updated 2 years ago
- ☆13Sep 22, 2026Updated last month
- Tools for all things related to Combinatory Categorial Grammar☆20Jul 12, 2025Updated last year
- Alto, the Algebraic Language Toolkit☆20May 22, 2024Updated 2 years ago
- ☆12Sep 29, 2021Updated 5 years ago
- A Python package for processing research with Minimalist grammars☆22Nov 13, 2021Updated 4 years ago
- chrisnager.com☆12Jul 12, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An R package of color palettes inspired by Nintendo games.☆17Feb 18, 2022Updated 4 years ago
- Gale-Church sentence aligner with options for variable parameters☆18Oct 7, 2019Updated 7 years ago
- Templates etc. for creating experiments using Ibex Farm.☆11Jul 21, 2018Updated 8 years ago
- Official implementation of "MoDoMoDo: Multi-Domain Data Mixtures for Multimodal LLM Reinforcement Learning"☆11Aug 23, 2025Updated last year
- OneStop: A 360-Participant Eye Tracking Dataset with Different Reading Regimes☆20Oct 20, 2026Updated 2 weeks ago
- Claude Code and Codex skill for the targets R package (targets >= 1.12). Modern patterns for reproducible analysis pipelines.☆16Jun 8, 2026Updated 4 months ago
- Corpora, tools and resources for Turkish NLP☆14May 27, 2020Updated 6 years ago