Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
☆131Mar 9, 2024Updated last year
Alternatives and similar repositories for sleeper-agents-paper
Users that are interested in sleeper-agents-paper are comparing it to the libraries listed below
Sorting:
- ☆25Sep 5, 2024Updated last year
- ☆22Sep 9, 2021Updated 4 years ago
- Display and customize Markdown text in SwiftUI☆37Jan 28, 2025Updated last year
- ☆18Feb 25, 2026Updated last week
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆116Jun 13, 2024Updated last year
- ☆15Mar 13, 2025Updated 11 months ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆217Updated this week
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆13Feb 13, 2023Updated 3 years ago
- Code for Preventing Language Models From Hiding Their Reasoning, which evaluates defenses against LLM steganography.☆25Jan 26, 2024Updated 2 years ago
- Sparse Autoencoder Training Library☆55May 1, 2025Updated 10 months ago
- A tiny easily hackable implementation of a feature dashboard.☆15Oct 21, 2025Updated 4 months ago
- ☆12Oct 23, 2022Updated 3 years ago
- ☆284Mar 2, 2024Updated 2 years ago
- CS194-196 Course Project☆14Feb 20, 2025Updated last year
- This is the official repository for the "Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP" paper acce…☆25Feb 16, 2026Updated 2 weeks ago
- Mamba support for transformer lens☆19Sep 17, 2024Updated last year
- Algebraic value editing in pretrained language models☆69Nov 1, 2023Updated 2 years ago
- Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifiers☆28Mar 1, 2025Updated last year
- ☆13Oct 5, 2025Updated 5 months ago
- ☆87Oct 8, 2025Updated 4 months ago
- ☆17Sep 4, 2024Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆19Dec 14, 2024Updated last year
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆209Jul 19, 2024Updated last year
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- ☆58Feb 12, 2024Updated 2 years ago
- Tools for understanding how transformer predictions are built layer-by-layer☆570Aug 7, 2025Updated 6 months ago
- A formalisation of Cartesian Frames, a perspective on embedded agency, in the HOL theorem prover.☆20Dec 20, 2021Updated 4 years ago
- Official repository for CVPR'23 paper: Detecting Backdoors in Pre-trained Encoders☆36Sep 25, 2023Updated 2 years ago
- Project exploring 3D volumetric rendering of NEXRAD radar data.☆11Oct 23, 2023Updated 2 years ago
- gpt completions in vscode☆35Mar 24, 2023Updated 2 years ago
- Code for paper "Universal Jailbreak Backdoors from Poisoned Human Feedback"☆66Apr 24, 2024Updated last year
- Erasing concepts from neural representations with provable guarantees☆243Jan 27, 2025Updated last year
- Machine Learning for Alignment Bootcamp☆82Apr 27, 2022Updated 3 years ago
- ☆22Nov 11, 2024Updated last year
- ☆52Oct 23, 2023Updated 2 years ago
- ☆25Apr 23, 2024Updated last year
- ☆273Oct 1, 2024Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆244Updated this week
- ☆147Jul 23, 2025Updated 7 months ago