Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• KaiNylund / lm-weights-encode-time
  ☆68Updated 11 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆88Updated 9 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 5 months ago
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆36Updated 8 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆51Updated 3 months ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆30Updated 4 months ago
• DeLLMa / DeLLMa
  Official Implementation of "DeLLMa: Decision Making Under Uncertainty with Large Language Models"
  ☆57Updated 8 months ago
• METR / RE-Bench
  ☆92Updated 2 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆86Updated last year
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆46Updated last year
• bhaweshiitk / ConformalLLM
  Extending Conformal Prediction to LLMs
  ☆67Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆101Updated 5 months ago
• OSU-NLP-Group / reversal-curse-binding
  ☆23Updated 3 months ago
• sher222 / LeReT
  Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval
  ☆39Updated 8 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆40Updated 9 months ago
• EdinburghNLP / torch-adaptive-imle
  ☆35Updated 7 months ago
• open-thought / reasoning-gym-eval
  Collection of LLM completions for reasoning-gym task datasets
  ☆26Updated last week
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆56Updated last year
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆33Updated 5 months ago
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆18Updated last month
• jmerullo / lm_vector_arithmetic
  ☆35Updated 2 years ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆75Updated 10 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 5 months ago
• Bradley-Butcher / Conformers
  Unofficial implementation of Conformal Language Modeling by Quach et al
  ☆29Updated 2 years ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 months ago
• causalNLP / corr2cause
  Data and code for the Corr2Cause paper (ICLR 2024)
  ☆106Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆77Updated 7 months ago
• brantondemoss / GrokkingComplexity
  Code for
  ☆27Updated 7 months ago