TomFrederik / unseal
Mechanistic Interpretability for Transformer Models
☆49Updated 2 years ago
Alternatives and similar repositories for unseal:
Users that are interested in unseal are comparing it to the libraries listed below
- Redwood Research's transformer interpretability tools☆13Updated 2 years ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆108Updated 2 years ago
- ☆25Updated 9 months ago
- Utilities for the HuggingFace transformers library☆63Updated last year
- ☆114Updated last year
- A library for efficient patching and automatic circuit discovery.☆46Updated last month
- Mechanistic Interpretability Visualizations using React☆219Updated 3 weeks ago
- ☆26Updated last year
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated 9 months ago
- ☆41Updated this week
- Tools for studying developmental interpretability in neural networks.☆82Updated 3 weeks ago
- Sparse Autoencoder Training Library☆38Updated 2 months ago
- we got you bro☆33Updated 5 months ago
- ☆201Updated 3 months ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆173Updated last year
- ☆53Updated 2 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆180Updated 3 years ago
- A dataset of alignment research and code to reproduce it☆73Updated last year
- Sparse and discrete interpretability tool for neural networks☆58Updated 11 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆28Updated 2 months ago
- 🧠 Starter templates for doing interpretability research☆64Updated last year
- ☆58Updated 2 years ago
- ☆106Updated 5 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆57Updated last year
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆27Updated 7 months ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆192Updated this week
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆18Updated last year
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆14Updated 9 months ago
- ☆19Updated 11 months ago
- Interpreting how transformers simulate agents performing RL tasks☆77Updated last year