Mechanistic Interpretability for Transformer Models
☆53Jun 1, 2022Updated 3 years ago
Alternatives and similar repositories for unseal
Users that are interested in unseal are comparing it to the libraries listed below
Sorting:
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 3 years ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆208Dec 22, 2021Updated 4 years ago
- Utilities for the HuggingFace transformers library☆75Jan 21, 2023Updated 3 years ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- ☆20Jan 21, 2023Updated 3 years ago
- ☆22Sep 9, 2021Updated 4 years ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆106Oct 4, 2023Updated 2 years ago
- Code for reproducing the results from the paper Avoiding Side Effects in Complex Environments☆12Jun 3, 2021Updated 4 years ago
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- ☆209Oct 14, 2025Updated 4 months ago
- Tools for understanding how transformer predictions are built layer-by-layer☆570Aug 7, 2025Updated 7 months ago
- 🖼️📊☆11Jun 9, 2020Updated 5 years ago
- A dataset of alignment research and code to reproduce it☆78Jun 22, 2023Updated 2 years ago
- A Discord bot for the Robert Miles AI server☆40Jan 27, 2026Updated last month
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆13Jan 26, 2025Updated last year
- A tiny easily hackable implementation of a feature dashboard.☆15Oct 21, 2025Updated 4 months ago
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Oct 9, 2022Updated 3 years ago
- Machine Learning for Alignment Bootcamp☆82Apr 27, 2022Updated 3 years ago
- ☆11Jun 2, 2021Updated 4 years ago
- ☆28May 4, 2023Updated 2 years ago
- ☆12Jun 27, 2024Updated last year
- Code for Multi-scale Orderless Pooling of Deep Convolutional Activation Features☆13Mar 6, 2017Updated 9 years ago
- Toki Pona corpus for NLTK☆15Dec 29, 2018Updated 7 years ago
- The Intermediate Goal of the project is to train a GPT like architecture to learn to summarise reddit posts from human preferences, as th…☆12Jul 14, 2021Updated 4 years ago
- Pytorch implementation on OpenAI's Procgen ppo-baseline, built from scratch.☆14May 17, 2024Updated last year
- Code publication to the paper "Normalized Attention Without Probability Cage"☆17Nov 9, 2021Updated 4 years ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆241Aug 11, 2025Updated 6 months ago
- Algebraic value editing in pretrained language models☆69Nov 1, 2023Updated 2 years ago
- Sparse probing paper full code.☆67Dec 17, 2023Updated 2 years ago
- TPU pod commander is a package for managing and launching jobs on Google Cloud TPU pods.☆21Sep 24, 2025Updated 5 months ago
- Automatically create Anki cards from text using language models☆20Jan 7, 2023Updated 3 years ago
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Dec 4, 2021Updated 4 years ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆16Sep 15, 2023Updated 2 years ago
- ☆18Feb 25, 2026Updated last week
- Official code for the paper: "Metadata Archaeology"☆19May 10, 2023Updated 2 years ago
- Squiggle programming language for intuitive probabilistic estimation features in Python☆81Jan 23, 2026Updated last month
- ☆156Dec 30, 2025Updated 2 months ago
- A JAX nn library☆21Sep 9, 2025Updated 6 months ago
- A formalisation of Cartesian Frames, a perspective on embedded agency, in the HOL theorem prover.☆20Dec 20, 2021Updated 4 years ago