ai-safety-foundation / sparse_autoencoderLinks
Sparse Autoencoder for Mechanistic Interpretability
☆284Updated last year
Alternatives and similar repositories for sparse_autoencoder
Users that are interested in sparse_autoencoder are comparing it to the libraries listed below
Sorting:
- ☆364Updated 2 months ago
- Using sparse coding to find distributed representations used by neural networks.☆283Updated 2 years ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆227Updated 11 months ago
- ☆252Updated last year
- Sparsify transformers with SAEs and transcoders☆654Updated last week
- ☆134Updated last month
- Mechanistic Interpretability Visualizations using React☆301Updated 11 months ago
- ☆132Updated 2 years ago
- ☆188Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆225Updated last week
- Training Sparse Autoencoders on Language Models☆1,047Updated this week
- ☆194Updated last month
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆697Updated this week
- ☆543Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆129Updated 8 months ago
- Steering Llama 2 with Contrastive Activation Addition☆193Updated last year
- This repository collects all relevant resources about interpretability in LLMs☆382Updated last year
- ☆56Updated last year
- ☆129Updated last year
- ☆212Updated 11 months ago
- Tools for understanding how transformer predictions are built layer-by-layer☆541Updated 3 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆299Updated 5 months ago
- Sparse Autoencoder Training Library☆55Updated 6 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆60Updated last year
- An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"☆49Updated last year
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆163Updated this week
- Modified to support crosscoder training.☆24Updated last month
- Sparse probing paper full code.☆65Updated last year
- ☆83Updated 8 months ago
- ☆79Updated last month