nrimsky / CAAView external linksLinks
Steering Llama 2 with Contrastive Activation Addition
☆207May 23, 2024Updated last year
Alternatives and similar repositories for CAA
Users that are interested in CAA are comparing it to the libraries listed below
Sorting:
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆100Sep 21, 2023Updated 2 years ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆140Feb 21, 2025Updated 11 months ago
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆27Nov 20, 2024Updated last year
- ☆207Oct 14, 2025Updated 4 months ago
- Algebraic value editing in pretrained language models☆68Nov 1, 2023Updated 2 years ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆340Jun 13, 2025Updated 8 months ago
- A resource repository for representation engineering in large language models☆148Nov 14, 2024Updated last year
- [ICLR 2025] General-purpose activation steering library☆141Sep 18, 2025Updated 4 months ago
- Materials for "Multi-property Steering of Large Language Models with Dynamic Activation Composition"☆14Nov 22, 2024Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆19Dec 14, 2024Updated last year
- Open source replication of Anthropic's Crosscoders for Model Diffing☆64Oct 27, 2024Updated last year
- ☆30Aug 2, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆240Dec 16, 2024Updated last year
- A tiny easily hackable implementation of a feature dashboard.☆15Oct 21, 2025Updated 3 months ago
- Training Sparse Autoencoders on Language Models☆1,201Updated this week
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆42Jul 28, 2024Updated last year
- ☆36Apr 30, 2024Updated last year
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆811Updated this week
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆21Oct 18, 2024Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆291Jul 20, 2024Updated last year
- ☆27Oct 6, 2024Updated last year
- ☆146Dec 30, 2025Updated last month
- A library for mechanistic interpretability of GPT-style language models☆3,073Updated this week
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆30Oct 27, 2025Updated 3 months ago
- Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering☆198Feb 13, 2025Updated last year
- ☆99Aug 8, 2024Updated last year
- [NeurIPS25] Official repo for "Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning"☆41Oct 3, 2025Updated 4 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆191Apr 17, 2025Updated 9 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆163Jun 25, 2025Updated 7 months ago
- Representation Engineering: A Top-Down Approach to AI Transparency☆947Aug 14, 2024Updated last year
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆858Jan 29, 2026Updated 2 weeks ago
- Sparsify transformers with SAEs and transcoders☆692Updated this week
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆72Jan 16, 2026Updated 3 weeks ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆83Nov 27, 2024Updated last year
- Code release for the paper "Style Vectors for Steering Generative Large Language Models", accepted to the Findings of the EACL 2024.☆36Sep 26, 2024Updated last year
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆241Updated this week
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆570Jan 28, 2025Updated last year
- Tools for optimizing steering vectors in LLMs.☆19Apr 10, 2025Updated 10 months ago
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year