Alternatives and similar repositories for sapbenchmark:

Users that are interested in sapbenchmark are comparing it to the libraries listed below

• byungdoh / llm_surprisal
  Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…
  ☆14Updated last year
• wilcoxeg / neural-networks-read-times
  Structural Supervision & Human Psycholinguistic Data
  ☆10Updated 3 years ago
• vansky / neural-complexity
  A neural language model that estimates incremental processing complexity
  ☆39Updated 3 years ago
• modelblocks / modelblocks-release
  A psycholinguistic modeling toolkit
  ☆26Updated last month
• wilcoxeg / verb_transitivity
  Data on verb transitivity in English and script to extract transitivity information from Google's syntactic ngrams corpus
  ☆11Updated 6 years ago
• carina-kauf / better-mlm-scoring
  [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring
  ☆10Updated last year
• decompositional-semantics-initiative / decomp
  The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit
  ☆57Updated last year
• rycolab / artificial-languages
  ☆12Updated 2 years ago
• languageMIT / naturalstories
  Corpus of naturalistic stories with annotation and psycholinguistic measures
  ☆53Updated 3 years ago
• m-hahn / grammar-optim
  Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"
  ☆15Updated 2 years ago
• aetting / lm-diagnostics
  Diagnostic tests for linguistic capacities in language models
  ☆66Updated 2 years ago
• kawine / contextual
  How Contextual are Contextualized Word Representations?
  ☆41Updated 4 years ago
• nert-nlp / AMR-Bibliography
  Organized inventory of research using the Abstract Meaning Representation
  ☆37Updated this week
• berzak / onestop-qa
  ☆24Updated 11 months ago
• cpllab / syntactic-generalization
  Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"
  ☆26Updated 3 years ago
• kanishkamisra / wugs-and-daxes
  Collection of academic works in natural language processing, computational linguistics, and computational cognitive science that study th…
  ☆18Updated last year
• ahmetustun / udapter
  UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…
  ☆31Updated 2 years ago
• rycolab / revisiting-uid
  Analysis pipeline for Revisiting UID (EMNLP 2021)
  ☆11Updated 2 years ago
• yanaiela / amnesic_probing
  ☆39Updated 3 years ago
• valentinhofmann / superbizarre
  Code and data for "Superbizarre Is Not Superb: Derivational Morphology Improves BERT's Interpretation of Complex Words"
  ☆16Updated 3 years ago
• flipz357 / smatchpp
  A package for handy processing of semantic graphs such as AMR, with a special focus on standardized evaluation
  ☆21Updated 6 months ago
• peterwestuw / surface-form-competition
  ☆58Updated 2 years ago
• sillsdev / giza-py
  A simple, Python-based, command-line runner for MGIZA++.
  ☆11Updated 3 years ago
• TalLinzen / rnn_agreement
  Evaluating recurrent neural networks on predicting subject-verb agreement dependencies
  ☆62Updated 2 years ago
• vboyce / Maze
  Code for auto-generating maze distractors and running maze in ibex
  ☆23Updated 8 months ago
• DiLi-Lab / EMTeC
  ☆10Updated last week
• naverlabseurope / ALPS2024-MT-LAB
  CD20200004 from 01/01/2021 to 31/12/2023 - LIG UGA - Python Notebook and Models for the MT Lab @ ALPS 2022
  ☆13Updated last year
• belindal / state-probes
  Code for the paper "Implicit Representations of Meaning in Neural Language Models"
  ☆53Updated 2 years ago
• kanishkamisra / minicons
  Utility for behavioral and representational analyses of Language Models
  ☆136Updated this week
• aalok-sathe / surprisal
  A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models…
  ☆37Updated 3 months ago