Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• KaiNylund / lm-weights-encode-time
  ☆68Updated last year
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆41Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆152Updated 11 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆112Updated 11 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆64Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆40Updated last year
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆19Updated 7 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆63Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 10 months ago
• microsoft / stop
  Self-Taught Optimizer (STOP): Recursively Self-Improving Code Generation
  ☆49Updated 2 years ago
• justinlovelace / Diffusion-Guided-LM
  ☆29Updated 3 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆91Updated last year
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆127Updated 7 months ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆32Updated 10 months ago
• OSU-NLP-Group / reversal-curse-binding
  ☆24Updated 9 months ago
• google-deepmind / neural_networks_solomonoff_induction
  Learning Universal Predictors
  ☆81Updated last year
• SalesforceAIResearch / LaTRO
  ☆123Updated 11 months ago
• JHU-CLSP / RATIONALYST
  Code for RATIONALYST: Pre-training Process-Supervision for Improving Reasoning https://arxiv.org/pdf/2410.01044
  ☆35Updated last year
• joshuacnf / Ctrl-G
  ☆105Updated last year
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆235Updated 6 months ago
• sdascoli / boolformer
  ☆164Updated last year
• TheDuckAI / arb
  Advanced Reasoning Benchmark Dataset for LLMs
  ☆47Updated 2 years ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆78Updated last year
• EdinburghNLP / torch-adaptive-imle
  ☆35Updated last year
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated last year
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆113Updated last year
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆42Updated 2 years ago
• METR / RE-Bench
  ☆133Updated 3 months ago
• neelsjain / BYOD
  The Official Repository for "Bring Your Own Data! Self-Supervised Evaluation for Large Language Models"
  ☆107Updated 2 years ago