HoagyC / sparse_coding
Using sparse coding to find distributed representations used by neural networks.
☆218Updated last year
Alternatives and similar repositories for sparse_coding:
Users that are interested in sparse_coding are comparing it to the libraries listed below
- Sparse Autoencoder for Mechanistic Interpretability☆224Updated 7 months ago
- ☆210Updated 5 months ago
- ☆120Updated last year
- ☆251Updated last month
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆184Updated 2 months ago
- ☆149Updated this week
- ☆159Updated this week
- ☆112Updated 7 months ago
- Mechanistic Interpretability Visualizations using React☆233Updated 2 months ago
- ☆60Updated 3 months ago
- Steering Llama 2 with Contrastive Activation Addition☆125Updated 9 months ago
- ☆62Updated this week
- Training Sparse Autoencoders on Language Models☆649Updated this week
- This repository collects all relevant resources about interpretability in LLMs☆324Updated 4 months ago
- ☆192Updated last year
- Sparsify transformers with SAEs and transcoders☆485Updated this week
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆95Updated this week
- ☆124Updated 3 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆90Updated 2 weeks ago
- ☆88Updated last month
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆91Updated last year
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆515Updated this week
- ☆435Updated 7 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆142Updated 5 months ago
- Sparse probing paper full code.☆55Updated last year
- An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"☆39Updated 10 months ago
- A library for efficient patching and automatic circuit discovery.☆56Updated 3 weeks ago
- ☆80Updated 7 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆44Updated 4 months ago
- A resource repository for representation engineering in large language models☆109Updated 3 months ago