Alternatives and similar repositories for switch_sae:

Users that are interested in switch_sae are comparing it to the libraries listed below

• katiekang1998 / reasoning_generalization
  ☆31Updated 4 months ago
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 11 months ago
• matchten / LoRA-Models-for-SAEs
  Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"
  ☆9Updated last month
• data-for-agents / insta
  Official Repo for InSTA: Towards Internet-Scale Training For Agents
  ☆36Updated 2 weeks ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 7 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆39Updated 6 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆73Updated 5 months ago
• JoshEngels / SAE-Dark-Matter
  Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"
  ☆22Updated 3 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆29Updated last month
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆25Updated 3 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆61Updated last year
• JacobPfau / fillerTokens
  ☆60Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆84Updated 5 months ago
• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 5 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆24Updated 5 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆40Updated 2 months ago
• hartvigsen-group / composable-interventions
  ☆28Updated 2 months ago
• mcleish7 / gemstone-scaling-laws
  ☆24Updated 2 months ago
• RobertCsordas / moeut
  ☆78Updated 8 months ago
• ctlllll / understanding_llm_benchmarks
  Understanding the correlation between different LLM benchmarks
  ☆29Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆72Updated 6 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆27Updated 7 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆84Updated 5 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 3 months ago
• JoshEngels / SAE-Probes
  Code for reproducing our paper "Are Sparse Autoencoders Useful? A Case Study in Sparse Probing"
  ☆19Updated last month
• samuelarnesen / nyu-debate-modeling
  ☆21Updated 7 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆77Updated last month
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆35Updated 11 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 3 months ago