Alternatives and similar repositories for benchmark:

Users that are interested in benchmark are comparing it to the libraries listed below

• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆33Updated 4 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆40Updated 9 months ago
• allenai / discoverybench
  Discovering Data-driven Hypotheses in the Wild
  ☆63Updated 3 months ago
• danielmamay / grokking
  Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.
  ☆35Updated last year
• jmerullo / lm_vector_arithmetic
  ☆33Updated last year
• KaiNylund / lm-weights-encode-time
  ☆67Updated 6 months ago
• ZonglinY / MOOSE
  [ACL 2024] <Large Language Models for Automated Open-domain Scientific Hypotheses Discovery>. It has also received the best poster award …
  ☆39Updated 4 months ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• bhaweshiitk / ConformalLLM
  Extending Conformal Prediction to LLMs
  ☆64Updated 8 months ago
• KoyenaPal / future-lens
  Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
  ☆18Updated last year
• EdinburghNLP / torch-adaptive-imle
  ☆34Updated 3 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆81Updated last year
• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆66Updated 8 months ago
• katiekang1998 / reasoning_generalization
  ☆29Updated 2 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆52Updated 11 months ago
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆24Updated last year
• Silent-Zebra / twisted-smc-lm
  ☆24Updated 2 weeks ago
• Yu-Fangxu / FoR
  Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples
  ☆76Updated last week
• technion-cs-nlp / llm-arithmetic-heuristics
  ☆15Updated last month
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆59Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 3 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆38Updated 4 months ago
• METR / RE-Bench
  ☆60Updated last month
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 9 months ago
• arcee-ai / DAM
  ☆48Updated 4 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆84Updated 5 months ago
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆16Updated 8 months ago