EleutherAI / sae
Sparse autoencoders
☆407Updated this week
Alternatives and similar repositories for sae:
Users that are interested in sae are comparing it to the libraries listed below
- Training Sparse Autoencoders on Language Models☆573Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆176Updated last month
- Sparse Autoencoder for Mechanistic Interpretability☆209Updated 5 months ago
- ☆179Updated this week
- Using sparse coding to find distributed representations used by neural networks.☆207Updated last year
- ☆135Updated this week
- Mechanistic Interpretability Visualizations using React☆219Updated 3 weeks ago
- ☆404Updated 5 months ago
- ☆201Updated 3 months ago
- ☆114Updated last year
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆458Updated this week
- Steering vectors for transformer language models in Pytorch / Huggingface☆78Updated last month
- ☆131Updated 3 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆153Updated 3 months ago
- Extract full next-token probabilities via language model APIs☆230Updated 10 months ago
- Steering Llama 2 with Contrastive Activation Addition☆113Updated 7 months ago
- This repository collects all relevant resources about interpretability in LLMs☆305Updated 2 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆82Updated this week
- ☆115Updated this week
- A toolkit for describing model features and intervening on those features to steer behavior.☆149Updated 2 months ago
- Tools for understanding how transformer predictions are built layer-by-layer☆459Updated 7 months ago
- ☆106Updated 5 months ago
- Improving Alignment and Robustness with Circuit Breakers☆174Updated 3 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆182Updated 7 months ago
- Erasing concepts from neural representations with provable guarantees☆219Updated last month
- ☆184Updated 10 months ago
- Understand and test language model architectures on synthetic tasks.☆175Updated this week
- ☆258Updated 10 months ago
- ☆53Updated 2 months ago