ai-safety-foundation / sparse_autoencoder
Sparse Autoencoder for Mechanistic Interpretability
☆215Updated 6 months ago
Alternatives and similar repositories for sparse_autoencoder:
Users that are interested in sparse_autoencoder are comparing it to the libraries listed below
- Using sparse coding to find distributed representations used by neural networks.☆213Updated last year
- ☆235Updated this week
- Mechanistic Interpretability Visualizations using React☆227Updated last month
- ☆203Updated 4 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆182Updated 2 months ago
- ☆116Updated last year
- Sparsify transformers with SAEs and transcoders☆458Updated this week
- ☆140Updated 2 weeks ago
- ☆149Updated this week
- Training Sparse Autoencoders on Language Models☆614Updated this week
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆488Updated this week
- ☆54Updated 2 months ago
- Steering Llama 2 with Contrastive Activation Addition☆122Updated 8 months ago
- ☆109Updated 6 months ago
- ☆50Updated last week
- Steering vectors for transformer language models in Pytorch / Huggingface☆87Updated 2 months ago
- ☆418Updated 6 months ago
- Sparse probing paper full code.☆53Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆87Updated last year
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆91Updated this week
- ☆86Updated this week
- This repository collects all relevant resources about interpretability in LLMs☆316Updated 3 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆179Updated 4 months ago
- A library for efficient patching and automatic circuit discovery.☆53Updated 2 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆36Updated 3 months ago
- ☆189Updated 11 months ago
- ☆25Updated 2 months ago
- A resource repository for representation engineering in large language models☆99Updated 3 months ago
- Sparse Autoencoder Training Library☆41Updated 3 months ago
- Decoder only transformer, built from scratch with PyTorch☆26Updated last year