Alternatives and similar repositories for benchmark

Users that are interested in benchmark are comparing it to the libraries listed below

• jmerullo / lm_vector_arithmetic
  ☆35Updated 2 years ago
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆27Updated last year
• KaiNylund / lm-weights-encode-time
  ☆68Updated 10 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆28Updated 3 months ago
• joshuacnf / Ctrl-G
  ☆85Updated 5 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆148Updated 4 months ago
• probcomp / LLaMPPL
  A domain-specific probabilistic programming language for modeling and inference with language models
  ☆131Updated last month
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 4 months ago
• brantondemoss / GrokkingComplexity
  Code for
  ☆27Updated 6 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆54Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆97Updated 4 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 5 months ago
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆75Updated 6 months ago
• allenai / SciRIFF
  Dataset and evaluation suite enabling LLM instruction-following for scientific literature understanding.
  ☆40Updated 3 months ago
• EdinburghNLP / torch-adaptive-imle
  ☆35Updated 6 months ago
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆35Updated 8 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated 2 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆63Updated last year
• thomasgauthier / LLM-self-play
  Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)
  ☆29Updated last year
• arcee-ai / DAM
  ☆51Updated 7 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆85Updated last year
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆70Updated last year
• OSU-NLP-Group / reversal-curse-binding
  ☆23Updated 2 months ago
• KoyenaPal / future-lens
  Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
  ☆18Updated last year
• JacobPfau / fillerTokens
  ☆65Updated last year
• jysohn1108 / Looped-Transformer
  Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…
  ☆27Updated 2 years ago
• ApolloResearch / apd
  Attribution-based Parameter Decomposition
  ☆25Updated 2 weeks ago
• METR / RE-Bench
  ☆87Updated 2 months ago