Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• KaiNylund / lm-weights-encode-time
  ☆69Updated last year
• google-deepmind / neural_networks_solomonoff_induction
  Learning Universal Predictors
  ☆79Updated last year
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆37Updated 10 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 11 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆150Updated 7 months ago
• sdascoli / boolformer
  ☆164Updated last year
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆39Updated last year
• joshuacnf / Ctrl-G
  ☆99Updated 8 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 7 months ago
• DAMO-NLP-SG / CaRing
  Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs
  ☆38Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 6 months ago
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆42Updated 10 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆192Updated last year
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆110Updated 3 months ago
• EdinburghNLP / torch-adaptive-imle
  ☆35Updated 9 months ago
• METR / RE-Bench
  ☆98Updated 4 months ago
• EleutherAI / improved-t5
  Experiments for efforts to train a new and improved t5
  ☆76Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆51Updated 5 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆77Updated 9 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆107Updated 7 months ago
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated last year
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆59Updated last year
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆42Updated 5 months ago
• OSU-NLP-Group / reversal-curse-binding
  ☆23Updated 5 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆42Updated 11 months ago
• google-deepmind / questbench
  ☆28Updated 4 months ago