callummcdougall / sae_vis
Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
☆199Updated 4 months ago
Alternatives and similar repositories for sae_vis:
Users that are interested in sae_vis are comparing it to the libraries listed below
- Mechanistic Interpretability Visualizations using React☆242Updated 4 months ago
- Sparsify transformers with SAEs and transcoders☆524Updated last week
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆170Updated last week
- Using sparse coding to find distributed representations used by neural networks.☆240Updated last year
- ☆121Updated last year
- ☆280Updated 2 months ago
- Sparse Autoencoder for Mechanistic Interpretability☆243Updated 9 months ago
- ☆223Updated 7 months ago
- ☆164Updated 3 weeks ago
- ☆93Updated 3 weeks ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆99Updated 2 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆54Updated 6 months ago
- ☆111Updated 5 months ago
- ☆114Updated 9 months ago
- Steering Llama 2 with Contrastive Activation Addition☆147Updated 11 months ago
- ☆38Updated this week
- ☆40Updated 5 months ago
- ☆27Updated last year
- Training Sparse Autoencoders on Language Models☆751Updated this week
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆555Updated this week
- Sparse Autoencoder Training Library☆49Updated last week
- ☆91Updated 2 months ago
- Extract full next-token probabilities via language model APIs☆242Updated last year
- ☆130Updated last month
- Erasing concepts from neural representations with provable guarantees☆228Updated 3 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆113Updated this week
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆120Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆64Updated 2 weeks ago
- ☆458Updated 9 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆73Updated 5 months ago