Code and results on finding one-shot steering vectors that mediate emergent misalignment
☆12Apr 12, 2025Updated last year
Alternatives and similar repositories for one-shot-steering-misalignment
Users that are interested in one-shot-steering-misalignment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Code for our paper: "Language Models Learn to Mislead Humans via RLHF""☆20Oct 11, 2024Updated 2 years ago
- A library for training crosscoders☆18May 28, 2025Updated last year
- Hyperbolic SVM in Python☆12Jun 21, 2022Updated 4 years ago
- Hyperbolic decision trees☆14Jun 6, 2026Updated 4 months ago
- ☆12Oct 23, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code repo for the model organisms and convergent directions of EM papers.☆90Sep 22, 2025Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆23Dec 14, 2024Updated last year
- Attribution-based Parameter Decomposition☆35Jun 11, 2025Updated last year
- A replication of Anthropic's Sleeper Agents and Stage-wise Model Diffing on a TinyStories language model.☆20Mar 17, 2025Updated last year
- Tools for optimizing steering vectors in LLMs.☆22Apr 10, 2025Updated last year
- A toolbox for learning neural topology of LLMs☆12Feb 27, 2026Updated 8 months ago
- ☆25May 25, 2024Updated 2 years ago
- [NeurIPS 2026 Poster] Flow-based Activation Steering for Inference-Time Intervention.☆20Sep 30, 2026Updated last month
- Data and analysis code for 'Offensive Cyber Task Horizons' (Payne, Miller, Peters, 2026)☆19May 27, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆47Jul 3, 2026Updated 3 months ago
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆17Dec 10, 2024Updated last year
- This repository contains code for the NeurIPS 2025 paper [Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Per…☆13Dec 1, 2025Updated 10 months ago
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆30Nov 20, 2024Updated last year
- SHE: Trajectory-driven Safety Harness Evolution for LLM Agents☆22Aug 4, 2026Updated 2 months ago
- [NeurIPS'22] Trap and Replace: Defending Backdoor Attacks by Trapping Them into an Easy-to-Replace Subnetwork. Haotao Wang, Junyuan Hong,…☆15Nov 27, 2023Updated 2 years ago
- 3cb: Catastrophic Cyber Capabilities Benchmarking of Large Language Models☆17Oct 30, 2024Updated 2 years ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆68Oct 27, 2024Updated 2 years ago
- [NeurIPS 2022] "Randomized Channel Shuffling: Minimal-Overhead Backdoor Attack Detection without Clean Datasets" by Ruisi Cai*, Zhenyu Zh…☆21Oct 1, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code to enable layer-level steering in LLMs using sparse auto encoders☆36Sep 18, 2025Updated last year
- [ACL 2024] Prompt Optimization via Adversarial In-Context Learning☆13Sep 4, 2024Updated 2 years ago
- Implementing stripe subscription in remix application☆13Feb 6, 2023Updated 3 years ago
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆58Oct 30, 2025Updated last year
- Conversion and transliteration of English to Nepali numbers and vice versa☆11May 12, 2026Updated 5 months ago
- [ICLR26] Unlearning Isn't Invisible: Detecting Unlearning Traces in LLMs from Model Outputs☆25Apr 8, 2026Updated 6 months ago
- A tiny easily hackable implementation of a feature dashboard.☆18Oct 21, 2025Updated last year
- Official code for Steering Large Language Models using Conceptors, presented at the NeurIPS 2024 MINT Workshop.☆16Mar 13, 2025Updated last year
- ☆20Mar 17, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A TinyStories LM with SAEs and transcoders☆16Aug 19, 2026Updated 2 months ago
- ☆17Oct 9, 2026Updated 3 weeks ago
- ☆19Oct 23, 2026Updated last week
- Sparse Autoencoder Training Library☆59May 1, 2025Updated last year
- [SDM'23] ML4C: Seeing Causality Through Latent Vicinity☆14Nov 9, 2022Updated 3 years ago
- Code for our paper "Decomposing The Dark Matter of Sparse Autoencoders"☆23Feb 6, 2025Updated last year
- Here are all the contents we use in our beginner track workshops.☆10Dec 2, 2020Updated 5 years ago