apartresearch / interpretability-starterLinks
🧠 Starter templates for doing interpretability research
☆76Updated 2 years ago
Alternatives and similar repositories for interpretability-starter
Users that are interested in interpretability-starter are comparing it to the libraries listed below
Sorting:
- Mechanistic Interpretability Visualizations using React☆320Updated last year
- Tools for studying developmental interpretability in neural networks.☆126Updated last month
- we got you bro☆37Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆240Updated last year
- ☆132Updated 2 years ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆238Updated 5 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆135Updated 3 years ago
- Attribution-based Parameter Decomposition☆33Updated 7 months ago
- ☆267Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆63Updated last year
- Erasing concepts from neural representations with provable guarantees☆243Updated last year
- ☆83Updated 11 months ago
- ☆284Updated last year
- Tools for understanding how transformer predictions are built layer-by-layer☆567Updated 6 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆241Updated 2 weeks ago
- ☆152Updated 5 months ago
- Sparse Autoencoder for Mechanistic Interpretability☆290Updated last year
- Sparse Autoencoder Training Library☆56Updated 9 months ago
- Mechanistic Interpretability for Transformer Models☆53Updated 3 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆217Updated 2 weeks ago
- ☆389Updated 5 months ago
- This was designed for interp researchers who want to do research on or with interp agents to give quality of life improvements and fix …☆121Updated 2 weeks ago
- ☆28Updated 2 years ago
- ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).☆337Updated 6 months ago
- ☆143Updated last month
- ☆88Updated last month
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆153Updated this week
- ☆29Updated last year
- Resources from the EleutherAI Math Reading Group☆54Updated 11 months ago
- Sparsify transformers with SAEs and transcoders☆688Updated 2 weeks ago