redwoodresearch / interp
Redwood Research's transformer interpretability tools
☆12Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for interp
- ☆18Updated last year
- Mechanistic Interpretability for Transformer Models☆49Updated 2 years ago
- Sparse Autoencoder Training Library☆27Updated 3 weeks ago
- ☆44Updated last month
- Scaling scaling laws with board games.☆43Updated last year
- ☆44Updated this week
- ☆24Updated 7 months ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆63Updated 2 years ago
- ☆54Updated 2 years ago
- Code for reproducing the results from the paper Avoiding Side Effects in Complex Environments☆12Updated 3 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆25Updated 5 months ago
- Minimal but scalable implementation of large language models in JAX☆26Updated 2 weeks ago
- Sparse and discrete interpretability tool for neural networks☆55Updated 9 months ago
- Language-annotated Abstraction and Reasoning Corpus☆78Updated last year
- Measuring the situational awareness of language models☆33Updated 9 months ago
- we got you bro☆33Updated 3 months ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆14Updated 7 months ago
- Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State☆17Updated 10 months ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆15Updated last year
- Interpreting how transformers simulate agents performing RL tasks☆73Updated last year
- ☆105Updated last month
- Tools for studying developmental interpretability in neural networks.☆77Updated last week
- ☆188Updated last month
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆13Updated 7 months ago
- ☆98Updated 3 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆65Updated last month
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆97Updated 2 years ago
- A dataset of alignment research and code to reproduce it☆69Updated last year
- A library for efficient patching and automatic circuit discovery.☆31Updated last month
- ☆9Updated 5 years ago