noanabeshima / tinymodel
A TinyStories LM with SAEs and transcoders
☆11Updated 3 weeks ago
Alternatives and similar repositories for tinymodel:
Users that are interested in tinymodel are comparing it to the libraries listed below
- ☆31Updated 11 months ago
- Sparse Autoencoder Training Library☆48Updated 5 months ago
- A library for efficient patching and automatic circuit discovery.☆63Updated this week
- ☆36Updated 2 months ago
- Experiments with representation engineering☆11Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆169Updated this week
- (Model-written) LLM evals library☆18Updated 4 months ago
- Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"☆31Updated 10 months ago
- ☆49Updated 3 months ago
- ☆219Updated 6 months ago
- Algebraic value editing in pretrained language models☆63Updated last year
- Code to enable layer-level steering in LLMs using sparse auto encoders☆16Updated 7 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆95Updated 2 months ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated 3 months ago
- Tools for studying developmental interpretability in neural networks.☆88Updated 3 months ago
- Notebooks accompanying Anthropic's "Toy Models of Superposition" paper☆120Updated 2 years ago
- ☆121Updated last year
- Situational Awareness Dataset☆27Updated 4 months ago
- ☆104Updated 5 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 11 months ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆15Updated 6 months ago
- ☆26Updated last year
- Applying SAEs for fine-grained control☆17Updated 4 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆52Updated 5 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆73Updated 4 months ago
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆14Updated last year
- ☆27Updated 8 months ago
- ☆62Updated 2 years ago
- ☆9Updated 4 months ago
- Measuring the situational awareness of language models☆34Updated last year