byungdoh / llm_surprisal
Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Amount, and Surprisal’s Fit to Reading Times," EACL24)
☆13Updated last year
Alternatives and similar repositories for llm_surprisal:
Users that are interested in llm_surprisal are comparing it to the libraries listed below
- SAP Benchmark☆15Updated 5 months ago
- A psycholinguistic modeling toolkit☆25Updated last week
- ☆12Updated 2 years ago
- Structural Supervision & Human Psycholinguistic Data☆10Updated 3 years ago
- A neural language model that estimates incremental processing complexity☆39Updated 3 years ago
- ☆16Updated 3 years ago
- ☆22Updated 3 years ago
- The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit☆57Updated last year
- Diagnostic tests for linguistic capacities in language models☆66Updated 2 years ago
- Corpus of naturalistic stories with annotation and psycholinguistic measures☆52Updated 3 years ago
- A package for handy processing of semantic graphs such as AMR, with a special focus on standardized evaluation☆20Updated 5 months ago
- Analysis pipeline for Revisiting UID (EMNLP 2021)☆11Updated 2 years ago
- Collection of available data sources for cognitively-inspired NLP☆39Updated 4 years ago
- ☆39Updated 3 years ago
- Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"☆26Updated 3 years ago
- Contextualised Word Representations for Lexical Semantic Change Analysis☆31Updated 4 years ago
- This project collects methods that enhance the comparison between AMR graphs.☆16Updated last year
- Discourse Probing of Pretrained Language Models. In Proceedings of NAACL 2021.☆10Updated 2 years ago
- Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"☆15Updated 2 years ago
- Scripts to evaluate scoped meaning representations☆19Updated 2 years ago
- Source code for CoNLL 2021 paper by Huebner et al. 2021☆17Updated last year
- ☆31Updated last month
- ☆18Updated 2 years ago
- Scripts for large-scale prediction of lexical semantic change.☆12Updated 2 years ago
- ☆24Updated 10 months ago
- A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models…☆37Updated 2 months ago
- Automated Semantic Analysis of Discourse Markers☆10Updated 2 years ago
- Data and code for "Nibbling at the Hard Core of Word Sense Disambiguation" (ACL 2022).☆15Updated 2 years ago