Alternatives and similar repositories for switch_sae:

Users that are interested in switch_sae are comparing it to the libraries listed below

• katiekang1998 / reasoning_generalization
  ☆26Updated last month
• JoshEngels / SAE-Dark-Matter
  Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"
  ☆19Updated last week
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated 4 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 2 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 2 weeks ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆37Updated 2 months ago
• JacobPfau / fillerTokens
  ☆58Updated 9 months ago
• SamsungSAILMontreal / nino
  Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]
  ☆18Updated last month
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆67Updated 2 months ago
• ExtensityAI / benchmark
  Evaluation of neuro-symbolic engines
  ☆34Updated 6 months ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆34Updated 8 months ago
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆18Updated last month
• google-deepmind / alta
  ☆21Updated 4 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆36Updated 4 months ago
• microsoft / mechanistic-error-probe
  A mechanistic approach for understanding and detecting factual errors of large language models.
  ☆40Updated 7 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆58Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆14Updated 2 weeks ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆40Updated 8 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆25Updated 9 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆20Updated 3 weeks ago
• RobertCsordas / moeut
  ☆71Updated 5 months ago
• jiahai-feng / binding-iclr
  ☆12Updated 11 months ago
• XiangLi1999 / AutoBencher
  ☆26Updated 7 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆39Updated 2 months ago
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated 11 months ago
• upiterbarg / lintseq
  [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)
  ☆14Updated this week