🧠 Starter templates for doing interpretability research
☆77Jul 16, 2023Updated 2 years ago
Alternatives and similar repositories for interpretability-starter
Users that are interested in interpretability-starter are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 👩💻 Code for the ACL paper "Detecting Edit Failures in LLMs: An Improved Specificity Benchmark"☆20Jan 19, 2024Updated 2 years ago
- ☆14Oct 30, 2024Updated last year
- Mechanistic Interpretability in Transformers: This repository explores advanced techniques like Induction Head Detection and QK Circuit A…☆35Sep 27, 2024Updated last year
- ☆20Feb 17, 2023Updated 3 years ago
- Repository with sample code using Apollo's suggested engineering practices☆15Dec 16, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Tools for studying developmental interpretability in neural networks.☆134Apr 23, 2026Updated last week
- A very hacky set of functions for getting plotly to do what I want when doing mech interp research, designed to be compatible with PyTorc…☆13Jun 16, 2023Updated 2 years ago
- A benchmark for mechanistic discovery of circuits in Transformers☆17Dec 15, 2024Updated last year
- Edit and explore Mosaic visualizations (real-time interaction for big datasets) in your browser☆22Oct 31, 2025Updated 6 months ago
- ☆1,056Updated this week
- Codebase for Obfuscated Activations Bypass LLM Latent-Space Defenses☆31Feb 11, 2025Updated last year
- Minimum Description Length probing for neural network representations☆20Jan 28, 2025Updated last year
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆189Apr 27, 2026Updated last week
- ☆14Feb 24, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated last year
- Official code for "Algorithmic Capabilities of Random Transformers" (NeurIPS 2024)☆16Sep 28, 2024Updated last year
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆47May 31, 2024Updated last year
- [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…☆18Dec 17, 2025Updated 4 months ago
- A library for mechanistic interpretability of GPT-style language models☆3,383Apr 30, 2026Updated last week
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆874Mar 6, 2026Updated 2 months ago
- Machine Learning for Alignment Bootcamp☆28Mar 7, 2024Updated 2 years ago
- ☆29Apr 4, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Tools for understanding how transformer predictions are built layer-by-layer☆586Aug 7, 2025Updated 8 months ago
- ☆281Oct 1, 2024Updated last year
- ☆32Aug 21, 2025Updated 8 months ago
- Training Sparse Autoencoders on Language Models☆1,361Updated this week
- A Language and Live Runtime for Styling and Labeling Typeset Math Formulas☆26Oct 29, 2023Updated 2 years ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆35Mar 8, 2025Updated last year
- ☆82Feb 18, 2026Updated 2 months ago
- we got you bro☆38Jul 29, 2024Updated last year
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆243Aug 11, 2025Updated 8 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- METR Task Standard☆179Feb 3, 2025Updated last year
- Find context neurons in Pythia models.☆13Jun 13, 2023Updated 2 years ago
- ☆11Oct 26, 2022Updated 3 years ago
- AI Data Management & Evaluation Platform☆214Oct 5, 2023Updated 2 years ago
- list of projects related to EA Software Engineers☆28Jun 23, 2023Updated 2 years ago
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆45Jun 30, 2024Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆296Jul 20, 2024Updated last year