Alternatives and similar repositories for evaluation-pipeline-2025

Users that are interested in evaluation-pipeline-2025 are comparing it to the libraries listed below

• CLMBRs / ultk
  A library for research in unnatural language semantics
  ☆13Updated 4 months ago
• craffel / llm-seminar
  Seminar on Large Language Models (COMP790-101 at UNC Chapel Hill, Fall 2022)
  ☆313Updated 3 years ago
• kanishkamisra / minicons
  Utility for behavioral and representational analyses of Language Models
  ☆171Updated 2 months ago
• srush / annotated-s4
  Implementation of https://srush.github.io/annotated-s4
  ☆505Updated 5 months ago
• vermashresth / awesome-emergent-languages
  Paper Reading in Neural Emergent Communication Literature
  ☆30Updated 3 years ago
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆211Updated last year
• google-deepmind / transformer_grammars
  Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale, TACL (2022)
  ☆133Updated 5 months ago
• tech-srl / RASP
  An interpreter for RASP as described in the ICML 2021 paper "Thinking Like Transformers"
  ☆322Updated last year
• fdalvi / NeuroX
  A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.
  ☆105Updated 2 years ago
• beinborn / brain-lang
  Code for processing brain data
  ☆12Updated 6 years ago
• curt-tigges / crosslayer-coding
  ☆15Updated 4 months ago
• carina-kauf / better-mlm-scoring
  [Kauf & Ivanova, ACL 2023] A Better Way to Do Masked Language Model Scoring
  ☆10Updated last year
• aalok-sathe / surprisal
  A unified interface for computing surprisal (log probabilities) from language models! Supports neural, symbolic, and black-box API models…
  ☆44Updated 3 months ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆60Updated last year
• tommccoy1 / embers-of-autoregression
  ☆29Updated 11 months ago
• inseq-team / inseq
  Interpretability for sequence generation models 🐛 🔍
  ☆446Updated last month
• tommccoy1 / inductive-bias-distillation
  ☆19Updated 5 months ago
• google-research / meliad
  ☆259Updated 5 months ago
• Waino / morfessor-emprune
  Morfessor EM+Prune
  ☆10Updated 5 years ago
• alexwarstadt / blimp
  The Benchmark of Linguistic Minimal Pairs
  ☆157Updated 2 years ago
• antonisa / lang2vec
  A simple library for querying the URIEL typological database.
  ☆92Updated last year
• rycolab / artificial-languages
  ☆12Updated 3 years ago
• nschneid / nlp-in-ling
  Natural Language Processing Research in North American Linguistics Departments
  ☆20Updated 2 weeks ago
• najoungkim / COGS
  ☆62Updated 3 years ago
• cdt-data-science / cluster-scripts
  A collection of useful scripts, templates, and examples for clusters using SLURM https://slurm.schedmd.com/
  ☆113Updated last year
• acmi-lab / cmu-10721-philosophy-machine-intelligence
  Official repository for CMU Machine Learning Department's 10721: "Philosophical Foundations of Machine Intelligence".
  ☆263Updated 2 years ago
• babylm / evaluation-pipeline-2024
  The evaluation pipeline for the 2024 BabyLM Challenge.
  ☆33Updated last year
• cimeister / tokenizer-analysis-suite
  ☆40Updated last week
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆132Updated 2 years ago
• EleutherAI / project-menu
  See the issue board for the current status of active and prospective projects!
  ☆65Updated 3 years ago