anthropics / attribution-graphs-frontendLinks
https://transformer-circuits.pub/2025/attribution-graphs/methods.html
☆90Updated 8 months ago
Alternatives and similar repositories for attribution-graphs-frontend
Users that are interested in attribution-graphs-frontend are comparing it to the libraries listed below
Sorting:
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆311Updated 5 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆231Updated last week
- ☆191Updated last year
- ☆552Updated last year
- A toolkit for describing model features and intervening on those features to steer behavior.☆220Updated last year
- Persona Vectors: Monitoring and Controlling Character Traits in Language Models☆304Updated 4 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆232Updated 11 months ago
- Performant framework for training, analyzing and visualizing Sparse Autoencoders (SAEs) and their frontier variants.☆168Updated this week
- Open source interpretability artefacts for R1.☆164Updated 7 months ago
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆234Updated 4 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆130Updated 9 months ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆202Updated last year
- ☆196Updated last month
- open source interpretability platform 🧠☆515Updated last week
- Reproducible, flexible LLM evaluations☆293Updated 3 weeks ago
- ☆58Updated last year
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆322Updated last month
- Sparsify transformers with SAEs and transcoders☆670Updated last week
- Steering Llama 2 with Contrastive Activation Addition☆196Updated last year
- Modified to support crosscoder training.☆24Updated 2 months ago
- Sparse Autoencoder for Mechanistic Interpretability☆284Updated last year
- ☆366Updated 3 months ago
- ☆200Updated 7 months ago
- ☆81Updated 2 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆63Updated last year
- ☆221Updated last year
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆122Updated last year
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆579Updated last month
- Using sparse coding to find distributed representations used by neural networks.☆287Updated 2 years ago
- ☆230Updated last week