noanabeshima / tinymodelLinks
A TinyStories LM with SAEs and transcoders
☆12Updated 3 months ago
Alternatives and similar repositories for tinymodel
Users that are interested in tinymodel are comparing it to the libraries listed below
Sorting:
- ☆32Updated last year
- Sparse Autoencoder Training Library☆53Updated 2 months ago
- Applying SAEs for fine-grained control☆22Updated 7 months ago
- ☆60Updated last week
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆127Updated 2 years ago
- A library for efficient patching and automatic circuit discovery.☆70Updated 2 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆57Updated 8 months ago
- ☆122Updated last year
- ☆28Updated last year
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated 5 months ago
- Tools for studying developmental interpretability in neural networks.☆99Updated 3 weeks ago
- A small package implementing some useful wrapping around nnsight☆14Updated last week
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆77Updated 7 months ago
- Codebase for "On Targeted Manipulation and Deception when Optimizing LLMs for User Feedback". This repo implements a generative multi-tur…☆17Updated 7 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆193Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆206Updated 7 months ago
- ☆231Updated 9 months ago
- ☆121Updated 11 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆115Updated 4 months ago
- Measuring the situational awareness of language models☆37Updated last year
- Code to enable layer-level steering in LLMs using sparse auto encoders☆22Updated 2 months ago
- ☆69Updated last month
- ☆182Updated 3 months ago
- ☆23Updated last year
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆40Updated last year
- Universal Neurons in GPT2 Language Models☆30Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆28Updated last year
- ☆11Updated 8 months ago
- Attribution-based Parameter Decomposition☆27Updated last month
- Algebraic value editing in pretrained language models☆65Updated last year