koayon / awesome-sparse-autoencoders
A curated reading list of research in Sparse Autoencoders, Feature Extraction and related topics in Mechanistic Interpretability
☆12Updated last month
Alternatives and similar repositories for awesome-sparse-autoencoders:
Users that are interested in awesome-sparse-autoencoders are comparing it to the libraries listed below
- ☆88Updated 3 weeks ago
- An Open Source Implementation of Anthropic's Paper: "Towards Monosemanticity: Decomposing Language Models with Dictionary Learning"☆38Updated 9 months ago
- Sparse Autoencoder Training Library☆42Updated 4 months ago
- A library for efficient patching and automatic circuit discovery.☆54Updated 2 weeks ago
- ☆146Updated this week
- Collection of Reverse Engineering in Large Model☆32Updated last month
- ☆58Updated this week
- ☆155Updated this week
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆24Updated 11 months ago
- Using sparse coding to find distributed representations used by neural networks.☆217Updated last year
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆94Updated this week
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆64Updated 3 months ago
- ☆59Updated 3 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆29Updated 9 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆68Updated 3 months ago
- ☆79Updated 6 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆40Updated 4 months ago
- ☆246Updated 2 weeks ago
- ☆29Updated 3 months ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆18Updated 3 weeks ago
- ☆20Updated this week
- Function Vectors in Large Language Models (ICLR 2024)☆140Updated 4 months ago
- ☆121Updated 3 months ago
- ☆207Updated 5 months ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆28Updated last month
- Steering Llama 2 with Contrastive Activation Addition☆124Updated 9 months ago
- ☆31Updated this week
- ☆14Updated 8 months ago