Steering Llama 2 with Contrastive Activation Addition
☆231May 23, 2024Updated 2 years ago
Alternatives and similar repositories for CAA
Users that are interested in CAA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆103Sep 21, 2023Updated 2 years ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆149Feb 21, 2025Updated last year
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆27Nov 20, 2024Updated last year
- Algebraic value editing in pretrained language models☆70Nov 1, 2023Updated 2 years ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆390Jun 13, 2025Updated 11 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Materials for "Multi-property Steering of Large Language Models with Dynamic Activation Composition"☆14Nov 22, 2024Updated last year
- ☆214Oct 14, 2025Updated 7 months ago
- [ICLR 2025] General-purpose activation steering library☆168Sep 18, 2025Updated 8 months ago
- A resource repository for representation engineering in large language models☆153Nov 14, 2024Updated last year
- ☆30Aug 2, 2024Updated last year
- Code release for the paper "Style Vectors for Steering Generative Large Language Models", accepted to the Findings of the EACL 2024.☆36Sep 26, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆259Feb 27, 2026Updated 2 months ago
- Training Sparse Autoencoders on Language Models☆1,389Updated this week
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆45Jul 28, 2024Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆31Oct 27, 2025Updated 6 months ago
- A library for mechanistic interpretability of GPT-style language models☆3,461Updated this week
- ☆284Oct 1, 2024Updated last year
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated last year
- ☆107Aug 8, 2024Updated last year
- Official repo for EMNLP'24 paper "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"☆30Oct 1, 2024Updated last year
- A tiny easily hackable implementation of a feature dashboard.☆16Oct 21, 2025Updated 7 months ago
- Sparse Autoencoder for Mechanistic Interpretability☆297Jul 20, 2024Updated last year
- Sparsify transformers with SAEs and transcoders☆720Apr 27, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆27Oct 6, 2024Updated last year
- Sparse Autoencoder Training Library☆57May 1, 2025Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆66Oct 27, 2024Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆21Dec 14, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆580Jan 28, 2025Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆186Mar 12, 2026Updated 2 months ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆930May 18, 2026Updated last week
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆86Nov 27, 2024Updated last year
- ☆121Feb 11, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Representation Engineering: A Top-Down Approach to AI Transparency☆994Aug 14, 2024Updated last year
- Mechanistic Interpretability Visualizations using React☆348Apr 30, 2026Updated 3 weeks ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆256May 18, 2026Updated last week
- ☆32Aug 9, 2024Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆88Mar 7, 2025Updated last year
- ☆38Apr 30, 2024Updated 2 years ago
- Function Vectors in Large Language Models (ICLR 2024)☆197Apr 30, 2026Updated 3 weeks ago