IBM / activation-steeringLinks
General-purpose activation steering library
☆78Updated last month
Alternatives and similar repositories for activation-steering
Users that are interested in activation-steering are comparing it to the libraries listed below
Sorting:
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆60Updated 6 months ago
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆72Updated 3 months ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆98Updated 4 months ago
- ☆44Updated 3 months ago
- ☆95Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆158Updated last year
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆94Updated last year
- A resource repository for representation engineering in large language models☆126Updated 7 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆39Updated 5 months ago
- ☆44Updated last year
- A library for efficient patching and automatic circuit discovery.☆66Updated 2 months ago
- Algebraic value editing in pretrained language models☆65Updated last year
- ☆35Updated last month
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆26Updated 10 months ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆108Updated 4 months ago
- ☆29Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆47Updated 8 months ago
- ☆84Updated 10 months ago
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆58Updated 2 weeks ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆95Updated 2 weeks ago
- AI Logging for Interpretability and Explainability🔬☆123Updated last year
- ☆40Updated last year
- Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".☆78Updated last year
- Function Vectors in Large Language Models (ICLR 2024)☆170Updated 2 months ago
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆68Updated 2 years ago
- code for EMNLP 2024 paper: Neuron-Level Knowledge Attribution in Large Language Models☆35Updated 7 months ago
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆77Updated 6 months ago
- Code for the paper "Spectral Editing of Activations for Large Language Model Alignments"☆24Updated 6 months ago
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆79Updated 2 months ago
- ☆51Updated last year