Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆152Updated 10 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆90Updated last year
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆40Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆65Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆112Updated 10 months ago
• google-deepmind / neural_networks_solomonoff_induction
  Learning Universal Predictors
  ☆81Updated last year
• joshuacnf / Ctrl-G
  ☆105Updated 11 months ago
• brantondemoss / GrokkingComplexity
  Code for
  ☆27Updated last year
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆49Updated last year
• sdascoli / boolformer
  ☆164Updated last year
• probcomp / LLaMPPL
  A domain-specific probabilistic programming language for modeling and inference with language models
  ☆138Updated 7 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆20Updated 10 months ago
• google-research / optformer
  ☆232Updated 2 weeks ago
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆39Updated 2 years ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆61Updated last year
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆234Updated 5 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆122Updated 6 months ago
• tommasomncttn / mergenetic
  Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).
  ☆96Updated 4 months ago
• EdinburghNLP / torch-adaptive-imle
  ☆35Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆71Updated last year
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆91Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated 2 years ago
• OSU-NLP-Group / reversal-curse-binding
  ☆24Updated 8 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 9 months ago
• bhaweshiitk / ConformalLLM
  Extending Conformal Prediction to LLMs
  ☆68Updated last year
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆198Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• arcee-ai / DAM
  ☆55Updated last year