Alternatives and similar repositories for benchmark:

Users that are interested in benchmark are comparing it to the libraries listed below

• OSU-NLP-Group / reversal-curse-binding
  ☆23Updated last month
• joshuacnf / Ctrl-G
  ☆80Updated 3 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆49Updated last month
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆27Updated last month
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆34Updated 6 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆54Updated last year
• jmerullo / lm_vector_arithmetic
  ☆34Updated last year
• KaiNylund / lm-weights-encode-time
  ☆67Updated 8 months ago
• ekinakyurek / google-research
  Google Research
  ☆46Updated 2 years ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 10 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 3 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆68Updated 2 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 8 months ago
• ucl-dark / llm_debate
  Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"
  ☆104Updated last year
• adamkarvonen / SAE_BoardGameEval
  ☆21Updated 3 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆61Updated last year
• METR / RE-Bench
  ☆73Updated last week
• katiekang1998 / reasoning_generalization
  ☆31Updated 3 months ago
• google-deepmind / questbench
  ☆16Updated this week
• wesg52 / universal-neurons
  Universal Neurons in GPT2 Language Models
  ☆28Updated 11 months ago
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆91Updated 2 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆73Updated 5 months ago
• victorvikram / ConceptARC
  Materials for ConceptARC paper
  ☆92Updated 5 months ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 3 months ago
• mandyyyyii / east
  ☆16Updated 3 weeks ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆145Updated 3 months ago
• awwang10 / llmpromptboosting
  Accompanying code for "Boosted Prompt Ensembles for Large Language Models"
  ☆30Updated 2 years ago
• EdinburghNLP / torch-adaptive-imle
  ☆34Updated 5 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆76Updated last month