TomFrederik / unsealView external linksLinks
Mechanistic Interpretability for Transformer Models
☆53Jun 1, 2022Updated 3 years ago
Alternatives and similar repositories for unseal
Users that are interested in unseal are comparing it to the libraries listed below
Sorting:
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 3 years ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆203Dec 22, 2021Updated 4 years ago
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆13Feb 13, 2023Updated 3 years ago
- ☆57Jun 15, 2023Updated 2 years ago
- Interpreting how transformers simulate agents performing RL tasks☆90Oct 23, 2023Updated 2 years ago
- ☆19Jan 21, 2023Updated 3 years ago
- ☆22Sep 9, 2021Updated 4 years ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆106Oct 4, 2023Updated 2 years ago
- Code for reproducing the results from the paper Avoiding Side Effects in Complex Environments☆12Jun 3, 2021Updated 4 years ago
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- ☆207Oct 14, 2025Updated 4 months ago
- Tools for understanding how transformer predictions are built layer-by-layer☆567Aug 7, 2025Updated 6 months ago
- Minimalistic Google Docs based workflow for Distill.pub☆10Jun 14, 2023Updated 2 years ago
- 🖼️📊☆11Jun 9, 2020Updated 5 years ago
- A library for finding knowledge neurons in pretrained transformer models.☆159Feb 13, 2022Updated 4 years ago
- A dataset of alignment research and code to reproduce it☆78Jun 22, 2023Updated 2 years ago
- A tiny easily hackable implementation of a feature dashboard.☆15Oct 21, 2025Updated 3 months ago
- ☆11Jun 2, 2021Updated 4 years ago
- ☆28May 4, 2023Updated 2 years ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆13Jan 26, 2025Updated last year
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Oct 9, 2022Updated 3 years ago
- ☆12Jun 27, 2024Updated last year
- Code for Multi-scale Orderless Pooling of Deep Convolutional Activation Features☆13Mar 6, 2017Updated 8 years ago
- Code publication to the paper "Normalized Attention Without Probability Cage"☆17Nov 9, 2021Updated 4 years ago
- Pytorch implementation on OpenAI's Procgen ppo-baseline, built from scratch.☆14May 17, 2024Updated last year
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆238Aug 11, 2025Updated 6 months ago
- Algebraic value editing in pretrained language models☆68Nov 1, 2023Updated 2 years ago
- Tools for studying developmental interpretability in neural networks.☆126Dec 30, 2025Updated last month
- Sparse probing paper full code.☆66Dec 17, 2023Updated 2 years ago
- TPU pod commander is a package for managing and launching jobs on Google Cloud TPU pods.☆21Sep 24, 2025Updated 4 months ago
- ☆17Feb 14, 2024Updated 2 years ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆16Sep 15, 2023Updated 2 years ago
- Official code for the paper: "Metadata Archaeology"☆19May 10, 2023Updated 2 years ago
- ☆17Updated this week
- ☆22May 3, 2022Updated 3 years ago
- Squiggle programming language for intuitive probabilistic estimation features in Python☆81Jan 23, 2026Updated 3 weeks ago
- ☆146Dec 30, 2025Updated last month
- ☆23Jun 23, 2022Updated 3 years ago
- Source code for the EMNLP 2020 long paper <Token-level Adaptive Training for Neural Machine Translation>.☆20Oct 28, 2022Updated 3 years ago