byungdoh / llm_surprisalLinks
Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Amount, and Surprisal’s Fit to Reading Times," EACL24)
☆15Updated last year
Alternatives and similar repositories for llm_surprisal
Users that are interested in llm_surprisal are comparing it to the libraries listed below
Sorting:
- SAP Benchmark☆17Updated 8 months ago
- ☆20Updated 3 years ago
- ☆12Updated 3 years ago
- A psycholinguistic modeling toolkit☆28Updated last week
- ☆11Updated last month
- Structural Supervision & Human Psycholinguistic Data☆10Updated 4 years ago
- Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"☆15Updated 2 years ago
- Corpus of naturalistic stories with annotation and psycholinguistic measures☆55Updated 3 weeks ago
- Collection of available data sources for cognitively-inspired NLP☆38Updated 4 years ago
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆28Updated 3 years ago
- Analysis pipeline for Revisiting UID (EMNLP 2021)☆11Updated 2 years ago
- A neural language model that estimates incremental processing complexity☆39Updated 3 years ago
- ☆16Updated 3 years ago
- A package for handy processing of semantic graphs such as AMR, with a special focus on standardized evaluation☆23Updated last month
- [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring☆10Updated last year
- Contextualised Word Representations for Lexical Semantic Change Analysis☆31Updated 4 years ago
- ☆24Updated last year
- Diagnostic tests for linguistic capacities in language models☆66Updated 3 years ago
- The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit☆57Updated 2 years ago
- ☆22Updated 3 years ago
- ☆28Updated 6 months ago
- Source code for CoNLL 2021 paper by Huebner et al. 2021☆19Updated last year
- This repository contains the Potsdam Textbook Corpus (PoTeC) which is a natural reading eye-tracking corpus.☆11Updated 4 months ago
- Utility for behavioral and representational analyses of Language Models☆146Updated this week
- This project collects methods that enhance the comparison between AMR graphs.☆16Updated last year
- A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models…☆40Updated 5 months ago
- Repository for DISRPT2023 shared task☆17Updated 10 months ago
- Automated Semantic Analysis of Discourse Markers☆10Updated 3 years ago
- Neural CRF Model for Sentence Alignment in Text Simplification☆67Updated 4 months ago
- Python version for Doug Biber's Multidimensional Analysis (MDA)☆31Updated 3 months ago