Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆64Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 9 months ago
• EdinburghNLP / torch-adaptive-imle
  ☆34Updated 11 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆111Updated 9 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆93Updated last month
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆39Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 8 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆193Updated last year
• google-deepmind / neural_networks_solomonoff_induction
  Learning Universal Predictors
  ☆81Updated last year
• probcomp / LLaMPPL
  A domain-specific probabilistic programming language for modeling and inference with language models
  ☆137Updated 6 months ago
• joshuacnf / Ctrl-G
  ☆104Updated 10 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆91Updated last year
• google-research / optformer
  ☆230Updated last week
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• sdascoli / boolformer
  ☆164Updated last year
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆60Updated last year
• google-deepmind / questbench
  ☆32Updated 6 months ago
• victorvikram / ConceptARC
  Materials for ConceptARC paper
  ☆105Updated last year
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆233Updated 3 months ago
• tommasomncttn / mergenetic
  Flexible library for merging large language models (LLMs) via evolutionary optimization (ACL 2025 Demo).
  ☆91Updated 3 months ago
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆111Updated last year
• requeima / llm_processes
  ☆66Updated 7 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆133Updated 10 months ago
• princeton-nlp / TransformerPrograms
  [NeurIPS 2023] Learning Transformer Programs
  ☆162Updated last year
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆75Updated last year
• causalNLP / cladder
  We develop benchmarks and analysis tools to evaluate the causal reasoning abilities of LLMs.
  ☆132Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 7 months ago
• etimush / ARC_NCA
  Repo for solving arc problems with an Neural Cellular Automata
  ☆21Updated 5 months ago