Steering Llama 2 with Contrastive Activation Addition
☆236May 23, 2024Updated 2 years ago
Alternatives and similar repositories for CAA
Users that are interested in CAA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆103Sep 21, 2023Updated 2 years ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆151Feb 21, 2025Updated last year
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆27Nov 20, 2024Updated last year
- Algebraic value editing in pretrained language models☆70Nov 1, 2023Updated 2 years ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆403Jun 13, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Materials for "Multi-property Steering of Large Language Models with Dynamic Activation Composition"☆14Nov 22, 2024Updated last year
- ☆218Oct 14, 2025Updated 8 months ago
- [ICLR 2025] General-purpose activation steering library☆174Sep 18, 2025Updated 8 months ago
- A resource repository for representation engineering in large language models☆153Nov 14, 2024Updated last year
- ☆30Aug 2, 2024Updated last year
- Code release for the paper "Style Vectors for Steering Generative Large Language Models", accepted to the Findings of the EACL 2024.☆36Sep 26, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆261Feb 27, 2026Updated 3 months ago
- Training Sparse Autoencoders on Language Models☆1,419Updated this week
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆46Jul 28, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆31Oct 27, 2025Updated 7 months ago
- A library for mechanistic interpretability of GPT-style language models☆3,553Updated this week
- ☆289Oct 1, 2024Updated last year
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated last year
- ☆109Aug 8, 2024Updated last year
- Official repo for EMNLP'24 paper "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"☆30Oct 1, 2024Updated last year
- A tiny easily hackable implementation of a feature dashboard.☆16Oct 21, 2025Updated 7 months ago
- Sparsify transformers with SAEs and transcoders☆725Jun 8, 2026Updated last week
- Sparse Autoencoder for Mechanistic Interpretability☆302Jul 20, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆27Oct 6, 2024Updated last year
- Sparse Autoencoder Training Library☆57May 1, 2025Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆67Oct 27, 2024Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆21Dec 14, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆582Jan 28, 2025Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆198Mar 12, 2026Updated 3 months ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆955Updated this week
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆87Nov 27, 2024Updated last year
- ☆123Feb 11, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Representation Engineering: A Top-Down Approach to AI Transparency☆1,006Aug 14, 2024Updated last year
- Mechanistic Interpretability Visualizations using React☆351Apr 30, 2026Updated last month
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆260Jun 8, 2026Updated last week
- ☆32Aug 9, 2024Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆88Mar 7, 2025Updated last year
- ☆38Apr 30, 2024Updated 2 years ago
- Function Vectors in Large Language Models (ICLR 2024)☆197Apr 30, 2026Updated last month