PAIR.withgoogle.com and friend's work on interpretability methods
☆221Feb 4, 2026Updated 3 weeks ago
Alternatives and similar repositories for interpretability
Users that are interested in interpretability are comparing it to the libraries listed below
Sorting:
- ☆209Oct 14, 2025Updated 4 months ago
- Sparsify transformers with SAEs and transcoders☆696Updated this week
- Open source replication of Anthropic's Crosscoders for Model Diffing☆64Oct 27, 2024Updated last year
- This repository includes code for the paper "Does Localization Inform Editing? Surprising Differences in Where Knowledge Is Stored vs. Ca…☆61May 9, 2023Updated 2 years ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆245Dec 16, 2024Updated last year
- Training Sparse Autoencoders on Language Models☆1,219Updated this week
- ☆68May 18, 2023Updated 2 years ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆62Mar 30, 2024Updated last year
- This repository collects all relevant resources about interpretability in LLMs☆390Nov 1, 2024Updated last year
- Tools for understanding how transformer predictions are built layer-by-layer☆567Aug 7, 2025Updated 6 months ago
- ☆396Aug 21, 2025Updated 6 months ago
- A library for mechanistic interpretability of GPT-style language models☆3,112Updated this week
- ☆19Mar 5, 2024Updated last year
- A framework for evaluating Machine Translation models.☆12May 26, 2025Updated 9 months ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- ☆284Mar 2, 2024Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆243Updated this week
- ☆571Jul 19, 2024Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆57Oct 30, 2025Updated 4 months ago
- ☆118Feb 11, 2025Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆168Updated this week
- A library for efficient patching and automatic circuit discovery.☆90Dec 31, 2025Updated 2 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆20Oct 24, 2025Updated 4 months ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆13Jan 26, 2025Updated last year
- Tools for optimizing steering vectors in LLMs.☆20Apr 10, 2025Updated 10 months ago
- ☆17Aug 30, 2025Updated 6 months ago
- Steering Llama 2 with Contrastive Activation Addition☆212May 23, 2024Updated last year
- ☆271Oct 1, 2024Updated last year
- Improving Alignment and Robustness with Circuit Breakers☆258Sep 24, 2024Updated last year
- ☆250Feb 22, 2024Updated 2 years ago
- Easy-to-use MIRAGE code for faithful answer attribution in RAG applications. Paper: https://aclanthology.org/2024.emnlp-main.347/☆26Mar 10, 2025Updated 11 months ago
- ☆19Sep 16, 2025Updated 5 months ago
- ☆14Apr 27, 2022Updated 3 years ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆99Sep 5, 2021Updated 4 years ago
- Using sparse coding to find distributed representations used by neural networks.☆297Nov 10, 2023Updated 2 years ago
- Sparse Autoencoder for Mechanistic Interpretability☆292Jul 20, 2024Updated last year
- This is the official repository for the "Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP" paper acce…☆25Feb 16, 2026Updated last week
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆351Jun 13, 2025Updated 8 months ago
- ☆113Feb 11, 2025Updated last year