Alternatives and similar repositories for evaluation-pipeline-2025

Users that are interested in evaluation-pipeline-2025 are comparing it to the libraries listed below

• kanishkamisra / minicons
  Utility for behavioral and representational analyses of Language Models
  ☆173Updated this week
• CLMBRs / ultk
  A library for research in unnatural language semantics
  ☆13Updated 5 months ago
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆509Updated 5 months ago
• craffel / llm-seminar
  Seminar on Large Language Models (COMP790-101 at UNC Chapel Hill, Fall 2022)
  ☆313Updated 3 years ago
• UIUCLearningLanguageLab / AOCHILDES
  Python API for loading language data from American-English CHILDES database
  ☆17Updated 3 years ago
• vermashresth / awesome-emergent-languages
  Paper Reading in Neural Emergent Communication Literature
  ☆30Updated 3 years ago
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆105Updated 2 years ago
• rycolab / artificial-languages
  ☆12Updated 3 years ago
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆212Updated last year
• najoungkim / COGS
  ☆62Updated 3 years ago
• rycolab / bayesian-mi
  This code accompanies the paper "Bayesian Framework for Information-Theoretic Probing" published in EMNLP 2021.
  ☆10Updated 4 years ago
• google-research / meliad
  ☆259Updated 6 months ago
• alexwarstadt / blimp
  The Benchmark of Linguistic Minimal Pairs
  ☆159Updated 3 years ago
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆133Updated 2 weeks ago
• babylm / evaluation-pipeline-2024
  The evaluation pipeline for the 2024 BabyLM Challenge.
  ☆33Updated last year
• beinborn / brain-lang
  Code for processing brain data
  ☆12Updated 6 years ago
• carina-kauf / better-mlm-scoring
  [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring
  ☆10Updated 2 years ago
• cimeister / tokenizer-analysis-suite
  ☆43Updated last month
• tech-srl / RASP
  An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"
  ☆323Updated last year
• antonisa / lang2vec
  A simple library for querying the URIEL typological database.
  ☆93Updated last year
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆449Updated 2 weeks ago
• DiLi-Lab / PoTeC
  This repository contains the Potsdam Textbook Corpus (PoTeC) which is a natural reading eye-tracking corpus.
  ☆14Updated last month
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆132Updated 2 years ago
• curt-tigges / crosslayer-coding
  ☆15Updated 5 months ago
• LeiLiLab / LingoLLM
  https://arxiv.org/pdf/2402.18025
  ☆31Updated 10 months ago
• tommccoy1 / embers-of-autoregression
  ☆29Updated 11 months ago
• rycolab / aflt-f2022
  ☆15Updated 3 years ago
• john-hewitt / truncation-sampling
  Codebase describing experiments in Truncation Sampling as Language Model Desmoothing
  ☆13Updated 3 years ago
• tommccoy1 / inductive-bias-distillation
  ☆19Updated 6 months ago
• likenneth / othello_world
  Emergent world representations: Exploring a sequence model trained on a synthetic task
  ☆197Updated 2 years ago