TomFrederik / unsealLinks
Mechanistic Interpretability for Transformer Models
☆53Updated 3 years ago
Alternatives and similar repositories for unseal
Users that are interested in unseal are comparing it to the libraries listed below
Sorting:
- Utilities for the HuggingFace transformers library☆72Updated 2 years ago
- Redwood Research's transformer interpretability tools☆14Updated 3 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆212Updated this week
- ☆131Updated 2 years ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆191Updated 2 years ago
- Erasing concepts from neural representations with provable guarantees☆239Updated 9 months ago
- ☆281Updated last year
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆129Updated 3 years ago
- ☆252Updated last year
- Mechanistic Interpretability Visualizations using React☆299Updated 10 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Updated 9 months ago
- See the issue board for the current status of active and prospective projects!☆65Updated 3 years ago
- Sparse Autoencoder Training Library☆55Updated 6 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆199Updated 3 years ago
- ☆129Updated last year
- Tools for studying developmental interpretability in neural networks.☆114Updated 4 months ago
- Language-annotated Abstraction and Reasoning Corpus☆94Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆79Updated 3 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆20Updated 2 weeks ago
- A library to create and manage configuration files, especially for machine learning projects.☆80Updated 3 years ago
- ☆55Updated 2 years ago
- PAIR.withgoogle.com and friend's work on interpretability methods☆209Updated last month
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆226Updated 10 months ago
- ☆29Updated last year
- NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers☆41Updated 9 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆28Updated last year
- ☆27Updated 2 years ago
- 🧠 Starter templates for doing interpretability research☆75Updated 2 years ago
- ☆70Updated 3 years ago