TransluceAI / observatory
A toolkit for describing model features and intervening on those features to steer behavior.
☆159Updated 3 months ago
Alternatives and similar repositories for observatory:
Users that are interested in observatory are comparing it to the libraries listed below
- ☆149Updated this week
- Steering vectors for transformer language models in Pytorch / Huggingface☆87Updated 2 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆182Updated 2 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆179Updated 4 months ago
- Improving Alignment and Robustness with Circuit Breakers☆181Updated 4 months ago
- Steering Llama 2 with Contrastive Activation Addition☆122Updated 8 months ago
- ☆121Updated this week
- Mechanistic Interpretability Visualizations using React☆227Updated last month
- ☆203Updated 4 months ago
- Repository for the paper Stream of Search: Learning to Search in Language☆137Updated last week
- ☆54Updated 2 months ago
- ☆116Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆87Updated last year
- Using sparse coding to find distributed representations used by neural networks.☆213Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆160Updated this week
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆91Updated this week
- ☆146Updated last week
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆67Updated 2 months ago
- ☆109Updated 6 months ago
- ☆140Updated 2 weeks ago
- Sparsify transformers with SAEs and transcoders☆458Updated this week
- A simple unified framework for evaluating LLMs☆195Updated last week
- ☆235Updated this week
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆182Updated 2 months ago
- Extract full next-token probabilities via language model APIs☆228Updated 11 months ago
- ☆76Updated 6 months ago
- Erasing concepts from neural representations with provable guarantees☆222Updated 2 weeks ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆36Updated 3 months ago
- ☆25Updated 2 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆97Updated 10 months ago