emergent-misalignment / emergent-misalignmentLinks
☆222Updated 7 months ago
Alternatives and similar repositories for emergent-misalignment
Users that are interested in emergent-misalignment are comparing it to the libraries listed below
Sorting:
- Open source interpretability artefacts for R1.☆163Updated 6 months ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆209Updated 11 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆292Updated 4 months ago
- Persona Vectors: Monitoring and Controlling Character Traits in Language Models☆269Updated 3 months ago
- Collection of evals for Inspect AI☆264Updated last week
- METR Task Standard☆163Updated 8 months ago
- open source interpretability platform 🧠☆455Updated 2 weeks ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆224Updated 10 months ago
- Improving Alignment and Robustness with Circuit Breakers☆238Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆126Updated 8 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆219Updated last week
- ☆79Updated 3 weeks ago
- https://transformer-circuits.pub/2025/attribution-graphs/methods.html☆88Updated 7 months ago
- ☆114Updated 2 weeks ago
- ☆142Updated last month
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.