Alternatives and similar repositories for lm-pragmatics

Users that are interested in lm-pragmatics are comparing it to the libraries listed below

• kanishkamisra / minicons
  Utility for behavioral and representational analyses of Language Models
  ☆141Updated 3 weeks ago
• TalLinzen / rnn_agreement
  Evaluating recurrent neural networks on predicting subject-verb agreement dependencies
  ☆63Updated 2 years ago
• cpllab / syntactic-generalization
  Code and data for "A Systematic Assessment of Syntactic Generalization in Neural Language Models"
  ☆28Updated 3 years ago
• beinborn / relative_importance
  ☆16Updated 3 years ago
• carina-kauf / better-mlm-scoring
  [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring
  ☆10Updated last year
• yanaiela / amnesic_probing
  ☆39Updated 3 years ago
• rycolab / revisiting-uid
  Analysis pipeline for Revisiting UID (EMNLP 2021)
  ☆11Updated 2 years ago
• aetting / lm-diagnostics
  Diagnostic tests for linguistic capacities in language models
  ☆66Updated 3 years ago
• john-hewitt / truncation-sampling
  Codebase describing experiments in Truncation Sampling as Language Model Desmoothing
  ☆11Updated 2 years ago
• kawine / contextual
  How Contextual are Contextualized Word Representations?
  ☆41Updated 5 years ago
• shauli-ravfogel / nullspace_projection
  ☆89Updated 2 years ago
• rycolab / artificial-languages
  ☆12Updated 3 years ago
• facebookresearch / Imppres
  This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…
  ☆19Updated 3 years ago
• antonisa / lang2vec
  A simple library for querying the URIEL typological database.
  ☆90Updated last year
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆55Updated 2 years ago
• caplabnyu / sapbenchmark
  SAP Benchmark
  ☆17Updated 8 months ago
• alexwarstadt / blimp
  The Benchmark of Linguistic Minimal Pairs
  ☆150Updated 2 years ago
• Yao-Dou / LENS
  ☆22Updated last year
• sileod / DiscSense
  Automated Semantic Analysis of Discourse Markers
  ☆10Updated 2 years ago
• google / wmt-mqm-human-evaluation
  ☆86Updated 7 months ago
• decompositional-semantics-initiative / decomp
  The Universal Decompositional Semantics (UDS) dataset and the Decomp toolkit
  ☆57Updated last year
• wjko2 / DCQA-Discourse-Comprehension-by-Question-Answering
  ☆9Updated 2 years ago
• rycolab / aclpub2
  ☆31Updated 3 months ago
• najoungkim / COGS
  ☆60Updated 2 years ago
• katherinethai / par3
  ☆27Updated 5 months ago
• rtmdrr / testSignificanceNLP
  ☆229Updated 4 years ago
• danieldeutsch / qaeval
  ☆15Updated 3 years ago
• lukemelas / mtob
  ☆34Updated 10 months ago
• byungdoh / llm_surprisal
  Surprisal calculation using HuggingFace LMs ("Frequency Explains the Inverse Correlation of Large Language Models’ Size, Training Data Am…
  ☆15Updated last year
• sillsdev / giza-py
  A simple, Python-based, command-line runner for MGIZA++.
  ☆11Updated 3 years ago