Steering Llama 2 with Contrastive Activation Addition
☆239May 23, 2024Updated 2 years ago
Alternatives and similar repositories for CAA
Users that are interested in CAA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆103Sep 21, 2023Updated 2 years ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆153Feb 21, 2025Updated last year
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆28Nov 20, 2024Updated last year
- Algebraic value editing in pretrained language models☆70Nov 1, 2023Updated 2 years ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆413Jun 13, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Materials for "Multi-property Steering of Large Language Models with Dynamic Activation Composition"☆14Nov 22, 2024Updated last year
- ☆219Oct 14, 2025Updated 8 months ago
- [ICLR 2025] General-purpose activation steering library☆178Sep 18, 2025Updated 9 months ago
- A resource repository for representation engineering in large language models☆155Nov 14, 2024Updated last year
- ☆30Aug 2, 2024Updated last year
- Code release for the paper "Style Vectors for Steering Generative Large Language Models", accepted to the Findings of the EACL 2024.☆36Sep 26, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆262Feb 27, 2026Updated 4 months ago
- Training Sparse Autoencoders on Language Models☆1,442Jun 24, 2026Updated last week
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆47Jul 28, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆31Oct 27, 2025Updated 8 months ago
- A library for mechanistic interpretability of GPT-style language models☆3,603Jun 27, 2026Updated last week
- ☆290Oct 1, 2024Updated last year
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated last year
- ☆111Aug 8, 2024Updated last year
- Official repo for EMNLP'24 paper "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"☆30Oct 1, 2024Updated last year
- A tiny easily hackable implementation of a feature dashboard.☆17Oct 21, 2025Updated 8 months ago
- Sparsify transformers with SAEs and transcoders☆729Jun 22, 2026Updated last week
- ☆27Oct 6, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Sparse Autoencoder for Mechanistic Interpretability☆302Jul 20, 2024Updated last year
- Sparse Autoencoder Training Library☆57May 1, 2025Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆68Oct 27, 2024Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆22Dec 14, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆581Jan 28, 2025Updated last year
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆205Mar 12, 2026Updated 3 months ago
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆971Jun 29, 2026Updated last week
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆88Nov 27, 2024Updated last year
- Code for 'The Linear Representation Hypothesis and the Geometry of Large Language Models' (ICML 2024)☆124Feb 11, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Representation Engineering: A Top-Down Approach to AI Transparency☆1,009Aug 14, 2024Updated last year
- Mechanistic Interpretability Visualizations using React☆353Apr 30, 2026Updated 2 months ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆262Updated this week
- ☆33Aug 9, 2024Updated last year
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆89Mar 7, 2025Updated last year
- ☆38Apr 30, 2024Updated 2 years ago
- Function Vectors in Large Language Models (ICLR 2024)☆198Apr 30, 2026Updated 2 months ago