TransluceAI / observatory
A toolkit for describing model features and intervening on those features to steer behavior.
☆149Updated 2 months ago
Alternatives and similar repositories for observatory:
Users that are interested in observatory are comparing it to the libraries listed below
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆153Updated 3 months ago
- ☆135Updated this week
- Steering vectors for transformer language models in Pytorch / Huggingface☆78Updated last month
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆82Updated this week
- ☆131Updated 3 months ago
- ☆106Updated 5 months ago
- ☆115Updated this week
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆176Updated last month
- ☆135Updated 3 months ago
- Improving Alignment and Robustness with Circuit Breakers☆174Updated 3 months ago
- Sparse autoencoders☆407Updated this week
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆175Updated last month
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆66Updated last month
- ☆53Updated 2 months ago
- Steering Llama 2 with Contrastive Activation Addition☆113Updated 7 months ago
- Functional Benchmarks and the Reasoning Gap☆82Updated 3 months ago
- ☆75Updated 5 months ago
- A simple unified framework for evaluating LLMs☆164Updated 3 weeks ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆154Updated 2 months ago
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆85Updated last year
- Using sparse coding to find distributed representations used by neural networks.☆207Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆118Updated 5 months ago
- ☆21Updated last month
- ☆201Updated 3 months ago
- ☆168Updated last year
- A library for efficient patching and automatic circuit discovery.☆46Updated last month
- ☆89Updated this week
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆182Updated 7 months ago
- Extract full next-token probabilities via language model APIs☆230Updated 10 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆66Updated last year