amudide / switch_saeLinks
Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)
☆25Updated last year
Alternatives and similar repositories for switch_sae
Users that are interested in switch_sae are comparing it to the libraries listed below
Sorting:
- ☆33Updated last year
- ☆91Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆94Updated last year
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆83Updated last year
- Applying SAEs for fine-grained control☆25Updated last year
- Sparse and discrete interpretability tool for neural networks☆65Updated last year
- ☆23Updated 11 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆198Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆161Updated 6 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆55Updated 5 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆190Updated 10 months ago
- PyTorch library for Active Fine-Tuning☆95Updated 3 months ago
- Replicating O1 inference-time scaling laws☆91Updated last year
- nanoGPT-like codebase for LLM training☆113Updated 2 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆234Updated 2 weeks ago
- ☆150Updated 4 months ago
- ☆75Updated last year
- Universal Neurons in GPT2 Language Models☆31Updated last year
- Sparse Autoencoder Training Library☆56Updated 8 months ago
- ☆73Updated 3 years ago
- Evaluating LLMs with fewer examples☆170Updated last year
- Synthetic data generation and benchmark implementation for "Episodic Memories Generation and Evaluation Benchmark for Large Language Mode…☆62Updated 3 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆87Updated last year
- Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"☆24Updated 11 months ago
- Code for reproducing our paper "Are Sparse Autoencoders Useful? A Case Study in Sparse Probing"☆31Updated 9 months ago
- Official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)☆63Updated this week
- Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.☆57Updated 11 months ago
- Open source interpretability artefacts for R1.☆165Updated 8 months ago
- A library for efficient patching and automatic circuit discovery.☆84Updated last week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆78Updated last year