Alternatives and similar repositories for benchmark:

Users that are interested in benchmark are comparing it to the libraries listed below

• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 9 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated 11 months ago
• jmerullo / lm_vector_arithmetic
  ☆34Updated last year
• EdinburghNLP / torch-adaptive-imle
  ☆34Updated 3 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆83Updated 3 months ago
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆27Updated 9 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆59Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆66Updated 9 months ago
• XiangLi1999 / AutoBencher
  ☆26Updated 8 months ago
• hamishivi / EasyLM
  Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…
  ☆69Updated 7 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆103Updated 11 months ago
• METR / RE-Bench
  ☆62Updated last month
• DAMO-NLP-SG / CaRing
  Neuro-Symbolic Integration Brings Causal and Reliable Reasoning Proofs
  ☆34Updated last year
• KaiNylund / lm-weights-encode-time
  ☆67Updated 7 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆84Updated 5 months ago
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• srush / mamba-primer
  ☆37Updated 11 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆142Updated last month
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆35Updated last year
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 6 months ago
• JacobPfau / fillerTokens
  ☆60Updated 10 months ago
• DeLLMa / DeLLMa
  Official Implementation of "DeLLMa: Decision Making Under Uncertainty with Large Language Models"
  ☆49Updated 5 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated last month
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 9 months ago
• facebookresearch / MemoryMosaics
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆38Updated last month
• Leiay / looped_transformer
  ☆24Updated last year
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆39Updated 3 months ago
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆33Updated 4 months ago