Alternatives and similar repositories for sapbenchmark

Users that are interested in sapbenchmark are comparing it to the libraries listed below

• byungdoh / llm_surprisal
  Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…
  ☆15Updated last year
• wilcoxeg / neural-networks-read-times
  Structural Supervision & Human Psycholinguistic Data
  ☆10Updated 4 years ago
• modelblocks / modelblocks-release
  A psycholinguistic modeling toolkit
  ☆28Updated last week
• vansky / neural-complexity
  A neural language model that estimates incremental processing complexity
  ☆39Updated 3 years ago
• rycolab / artificial-languages
  ☆12Updated 3 years ago
• carina-kauf / better-mlm-scoring
  [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring
  ☆10Updated last year
• wilcoxeg / verb_transitivity
  Data on verb transitivity in English and script to extract transitivity information from Google's syntactic ngrams corpus
  ☆11Updated 6 years ago
• m-hahn / grammar-optim
  Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"
  ☆15Updated 2 years ago
• languageMIT / naturalstories
  Corpus of naturalistic stories with annotation and psycholinguistic measures
  ☆55Updated 3 weeks ago
• decompositional-semantics-initiative / decomp
  The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit
  ☆57Updated 2 years ago
• cpllab / syntactic-generalization
  Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"
  ☆28Updated 3 years ago
• kanishkamisra / minicons
  Utility for behavioral and representational analyses of Language Models
  ☆146Updated this week
• rycolab / revisiting-uid
  Analysis pipeline for Revisiting UID (EMNLP 2021)
  ☆11Updated 2 years ago
• DiLi-Lab / EMTeC
  ☆11Updated last month
• DiLi-Lab / PoTeC
  This repository contains the Potsdam Textbook Corpus (PoTeC) which is a natural reading eye-tracking corpus.
  ☆11Updated 4 months ago
• aetting / lm-diagnostics
  Diagnostic tests for linguistic capacities in language models
  ☆66Updated 3 years ago
• berzak / onestop-qa
  ☆24Updated last year
• katherinethai / par3
  ☆28Updated 6 months ago
• valentinhofmann / superbizarre
  Code and data for "Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex Words"
  ☆16Updated 3 years ago
• facebookresearch / Imppres
  This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…
  ☆19Updated 3 years ago
• flipz357 / smatchpp
  A package for handy processing of semantic graphs such as AMR, with a special focus on standardized evaluation
  ☆23Updated last month
• TalLinzen / rnn_agreement
  Evaluating recurrent neural networks on predicting subject-verb agreement dependencies
  ☆63Updated 2 years ago
• vboyce / Maze
  Code for auto-generating maze distractors and running maze in ibex
  ☆23Updated 10 months ago
• kawine / contextual
  How Contextual are Contextualized Word Representations?
  ☆41Updated 5 years ago
• IBM / transformers-struct-guidance
  Code for the ACL 2021 paper "Structural Guidance for Transformer Language Models"
  ☆13Updated 3 weeks ago
• aistairc / rnng-pytorch
  ☆22Updated 3 years ago
• aalok-sathe / surprisal
  A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models…
  ☆40Updated 5 months ago
• naverlabseurope / ALPS2024-MT-LAB
  CD20200004 from 01/01/2021 to 31/12/2023 - LIG UGA - Python Notebook and Models for the MT Lab @ ALPS 2022
  ☆13Updated last year
• phueb / BabyBERTa
  Source code for CoNLL 2021 paper by Huebner et al. 2021
  ☆19Updated last year
• berzak / celer
  ☆20Updated 3 years ago