amudide / switch_saeLinks
Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)
☆25Updated last year
Alternatives and similar repositories for switch_sae
Users that are interested in switch_sae are comparing it to the libraries listed below
Sorting:
- ☆33Updated 11 months ago
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆93Updated last year
- Sparse and discrete interpretability tool for neural networks☆65Updated last year
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆84Updated last year
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 5 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆196Updated last year
- Official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)☆58Updated 2 months ago
- Exploration of automated dataset selection approaches at large scales.☆51Updated 9 months ago
- PyTorch library for Active Fine-Tuning☆95Updated 2 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆86Updated last year
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆30Updated 2 months ago
- Applying SAEs for fine-grained control☆25Updated last year
- Replicating O1 inference-time scaling laws☆91Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆154Updated 5 months ago
- ☆75Updated last year
- This is a repository for "PMET: Precise Model Editing in a Transformer"☆55Updated 2 years ago
- One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation☆45Updated last month
- Universal Neurons in GPT2 Language Models☆31Updated last year
- Reinforcing General Reasoning without Verifiers☆92Updated 5 months ago
- ☆32Updated 5 months ago
- ☆23Updated 10 months ago
- Code for reproducing our paper "Are Sparse Autoencoders Useful? A Case Study in Sparse Probing"☆31Updated 8 months ago
- Open source interpretability artefacts for R1.☆164Updated 7 months ago
- ☆89Updated last year
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆28Updated last year
- nanoGPT-like codebase for LLM training☆113Updated last month
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆62Updated 2 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆76Updated last year
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆57Updated last year