Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• OSU-NLP-Group / reversal-curse-binding
  ☆23Updated 2 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 4 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆50Updated 2 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆54Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 11 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆86Updated 8 months ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆28Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆36Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆75Updated 6 months ago
• Silent-Zebra / twisted-smc-lm
  ☆29Updated 2 months ago
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆40Updated 7 months ago
• Yu-Fangxu / FoR
  [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples
  ☆88Updated last week
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated 9 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆146Updated 4 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆85Updated 6 months ago
• google-deepmind / neural_networks_solomonoff_induction
  Learning Universal Predictors
  ☆74Updated 10 months ago
• justinlovelace / Diffusion-Guided-LM
  ☆27Updated 9 months ago
• samblouir / birdie
  ☆13Updated last week
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 4 months ago
• XiangLi1999 / AutoBencher
  ☆29Updated 10 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆29Updated last year
• microsoft / stop
  Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
  ☆42Updated last year
• METR / RE-Bench
  ☆76Updated last month
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆107Updated last year
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆77Updated 3 months ago
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆34Updated 7 months ago
• Qualcomm-AI-research / codeit
  ☆26Updated 11 months ago