IBM / activation-steering
General-purpose activation steering library
☆56Updated 3 months ago
Alternatives and similar repositories for activation-steering:
Users that are interested in activation-steering are comparing it to the libraries listed below
- A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.☆71Updated last month
- A resource repository for representation engineering in large language models☆116Updated 5 months ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆53Updated 4 months ago
- Steering Llama 2 with Contrastive Activation Addition☆137Updated 10 months ago
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆91Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆96Updated last month
- ☆93Updated last year
- ☆22Updated last month
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆107Updated last year
- Algebraic value editing in pretrained language models☆64Updated last year
- LoFiT: Localized Fine-tuning on LLM Representations☆35Updated 2 months ago
- A library for efficient patching and automatic circuit discovery.☆62Updated last month
- [NeurIPS 2024] How do Large Language Models Handle Multilingualism?☆31Updated 5 months ago
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆11Updated 2 months ago
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆66Updated 2 years ago
- ☆41Updated last year
- ☆38Updated last year
- ☆37Updated last year
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆22Updated 10 months ago
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆74Updated 2 weeks ago
- For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.☆107Updated this week
- ☆29Updated 11 months ago
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆21Updated 8 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆156Updated 3 weeks ago
- Weak-to-Strong Jailbreaking on Large Language Models☆72Updated last year
- [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs☆37Updated 2 months ago
- ☆25Updated this week
- ☆82Updated 8 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆63Updated 2 weeks ago
- Steering vectors for transformer language models in Pytorch / Huggingface☆94Updated last month