TransluceAI / observatoryLinks
A toolkit for describing model features and intervening on those features to steer behavior.
☆190Updated 7 months ago
Alternatives and similar repositories for observatory
Users that are interested in observatory are comparing it to the libraries listed below
Sorting:
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆184Updated last week
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆231Updated last week
- Steering vectors for transformer language models in Pytorch / Huggingface☆106Updated 4 months ago
- ☆129Updated 7 months ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆202Updated 6 months ago
- Mechanistic Interpretability Visualizations using React☆255Updated 6 months ago
- ☆134Updated 2 months ago
- Steering Llama 2 with Contrastive Activation Addition☆158Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆148Updated 4 months ago
- Open source interpretability artefacts for R1.☆149Updated 2 months ago
- Improving Alignment and Robustness with Circuit Breakers☆211Updated 8 months ago
- ☆173Updated 2 months ago
- A library for efficient patching and automatic circuit discovery.☆66Updated 2 months ago
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆94Updated last year
- ☆84Updated 10 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆79Updated last year
- ☆97Updated 4 months ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆121Updated this week
- ☆226Updated 8 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆95Updated 2 weeks ago
- ☆101Updated 2 weeks ago
- Using sparse coding to find distributed representations used by neural networks.☆253Updated last year
- A simple unified framework for evaluating LLMs☆217Updated 2 months ago
- ☆65Updated 3 weeks ago
- ☆180Updated 2 months ago
- METR Task Standard☆150Updated 4 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆75Updated 6 months ago
- Collection of evals for Inspect AI☆155Updated this week
- Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'☆218Updated 6 months ago
- ☆119Updated 10 months ago