Mechanistic Interpretability for Transformer Models
☆53Jun 1, 2022Updated 4 years ago
Alternatives and similar repositories for unseal
Users that are interested in unseal are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 4 years ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆223Dec 22, 2021Updated 4 years ago
- Interpreting how transformers simulate agents performing RL tasks☆90Oct 23, 2023Updated 2 years ago
- ☆58Jun 15, 2023Updated 3 years ago
- Utilities for the HuggingFace transformers library☆76Jan 21, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆219Oct 14, 2025Updated 8 months ago
- Sparse probing paper full code.☆68Dec 17, 2023Updated 2 years ago
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Dec 4, 2021Updated 4 years ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- Algebraic value editing in pretrained language models☆70Nov 1, 2023Updated 2 years ago
- ☆20Feb 17, 2023Updated 3 years ago
- Tools for understanding how transformer predictions are built layer-by-layer☆594Aug 7, 2025Updated 10 months ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆13Jan 26, 2025Updated last year
- A formalisation of Cartesian Frames, a perspective on embedded agency, in the HOL theorem prover.☆22Dec 20, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Machine Learning for Alignment Bootcamp☆83Apr 27, 2022Updated 4 years ago
- ☆26Feb 20, 2026Updated 3 months ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆108Oct 4, 2023Updated 2 years ago
- A dataset of alignment research and code to reproduce it☆79Jun 22, 2023Updated 2 years ago
- A library for finding knowledge neurons in pretrained transformer models.☆160Feb 13, 2022Updated 4 years ago
- see github.com/understanding-search/maze-transformer☆10Dec 8, 2023Updated 2 years ago
- ☆170May 1, 2026Updated last month
- ☆22Sep 9, 2021Updated 4 years ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆244Aug 11, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fetch forecasts from prediction markets/forecasting platforms to make them searchable. Integrate these forecasts into other services.☆68Feb 9, 2025Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆261Feb 27, 2026Updated 3 months ago
- ☆16Jul 10, 2023Updated 2 years ago
- Squiggle programming language for intuitive probabilistic estimation features in Python☆84Jun 8, 2026Updated last week
- Tools for studying developmental interpretability in neural networks.☆140Apr 23, 2026Updated last month
- Official implementation of the paper "Topographic VAEs learn Equivariant Capsules"☆81Mar 4, 2022Updated 4 years ago
- The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…☆103Sep 5, 2021Updated 4 years ago
- Code for the paper "Implicit Representations of Meaning in Neural Language Models"☆57Feb 14, 2023Updated 3 years ago
- 🖼️📊☆11Jun 9, 2020Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official code for the paper: "Metadata Archaeology"☆19May 10, 2023Updated 3 years ago
- ☆565Feb 5, 2024Updated 2 years ago
- A tiny easily hackable implementation of a feature dashboard.☆16Oct 21, 2025Updated 7 months ago
- Benchmark to estimate model sycophancy☆30Nov 30, 2025Updated 6 months ago
- Fluent dreaming for language models☆13Jul 22, 2024Updated last year
- Code for reproducing the results from the paper Avoiding Side Effects in Complex Environments☆12Jun 3, 2021Updated 5 years ago
- The Intermediate Goal of the project is to train a GPT like architecture to learn to summarise reddit posts from human preferences, as th…☆12Jul 14, 2021Updated 4 years ago