byungdoh / llm_surprisal

Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Amount, and Surprisal’s Fit to Reading Times," EACL24)
13Updated last year

Alternatives and similar repositories for llm_surprisal:

Users that are interested in llm_surprisal are comparing it to the libraries listed below