Alternatives and similar repositories for evaluation-pipeline-2025

Users that are interested in evaluation-pipeline-2025 are comparing it to the libraries listed below

• kanishkamisra / minicons
  Utility for behavioral and representational analyses of Language Models
  ☆173Updated 3 weeks ago
• craffel / llm-seminar
  Seminar on Large Language Models (COMP790-101 at UNC Chapel Hill, Fall 2022)
  ☆313Updated 3 years ago
• vermashresth / awesome-emergent-languages
  Paper Reading in Neural Emergent Communication Literature
  ☆30Updated 4 years ago
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆512Updated 7 months ago
• CLMBRs / ultk
  A library for research in unnatural language semantics
  ☆13Updated this week
• ARBORproject / arborproject.github.io
  ☆83Updated 11 months ago
• alexwarstadt / blimp
  The Benchmark of Linguistic Minimal Pairs
  ☆161Updated 3 years ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆265Updated last year
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆106Updated 2 years ago
• babylm / evaluation-pipeline-2024
  The evaluation pipeline for the 2024 BabyLM Challenge.
  ☆33Updated last year
• google-research / meliad
  ☆259Updated 7 months ago
• tech-srl / RASP
  An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"
  ☆323Updated last year
• najoungkim / COGS
  ☆62Updated 3 years ago
• UIUCLearningLanguageLab / AOCHILDES
  Python API for loading language data from American-English CHILDES database
  ☆17Updated 3 years ago
• tommccoy1 / embers-of-autoregression
  ☆29Updated last year
• rycolab / bayesian-mi
  This code accompanies the paper "Bayesian Framework for Information-Theoretic Probing" published in EMNLP 2021.
  ☆10Updated 4 years ago
• curt-tigges / crosslayer-coding
  ☆16Updated 6 months ago
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆134Updated last week
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆454Updated 3 weeks ago
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆212Updated last year
• m-hahn / grammar-optim
  Code and Results for "Universals of word order reflect optimization of grammars for efficient communication"
  ☆14Updated 3 years ago
• mt-upc / transformer-contributions
  Measuring the Mixing of Contextual Information in the Transformer
  ☆34Updated 2 years ago
• krishnap25 / mauve
  Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.
  ☆307Updated last year
• antonisa / lang2vec
  A simple library for querying the URIEL typological database.
  ☆95Updated last year
• interpretingdl / eacl2024_transformer_interpretability_tutorial
  Materials for EACL2024 tutorial: Transformer-specific Interpretability
  ☆63Updated last year
• redwoodresearch / Easy-Transformer
  ☆137Updated last year
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆318Updated last year
• TomFrederik / unseal
  Mechanistic Interpretability for Transformer Models
  ☆53Updated 3 years ago
• mlepori1 / NeuroSurgeon
  NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers
  ☆42Updated 11 months ago
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆242Updated last year