A resource repository for representation engineering in large language models
☆156Nov 14, 2024Updated last year
Alternatives and similar repositories for awesome-representation-engineering
Users that are interested in awesome-representation-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation repository for the paper Towards General Conceptual Model Editing via Adversarial Representation Engineering.☆20Dec 6, 2024Updated last year
- [ICLR 2025] General-purpose activation steering library☆181Sep 18, 2025Updated 10 months ago
- Representation Engineering: A Top-Down Approach to AI Transparency☆1,013Aug 14, 2024Updated last year
- Steering vectors for transformer language models in Pytorch / Huggingface☆157Feb 21, 2025Updated last year
- Improving Alignment and Robustness with Circuit Breakers☆266Sep 24, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆14Feb 24, 2025Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆241May 23, 2024Updated 2 years ago
- ☆25Jun 13, 2024Updated 2 years ago
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆50Jul 28, 2024Updated last year
- Algebraic value editing in pretrained language models☆71Nov 1, 2023Updated 2 years ago
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆83Jun 20, 2026Updated last month
- A curated list of resources for activation engineering☆140Oct 2, 2025Updated 9 months ago
- ☆60Jun 13, 2024Updated 2 years ago
- PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)☆43Jan 18, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…☆13Jan 26, 2025Updated last year
- Code release for the paper "Style Vectors for Steering Generative Large Language Models", accepted to the Findings of the EACL 2024.☆37Sep 26, 2024Updated last year
- Materials for "Multi-property Steering of Large Language Models with Dynamic Activation Composition"☆14Nov 22, 2024Updated last year
- ☆257Feb 22, 2024Updated 2 years ago
- ☆30Aug 2, 2024Updated last year
- Stanford NLP Python library for understanding and improving PyTorch models via interventions☆893Mar 6, 2026Updated 4 months ago
- Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"☆108May 20, 2025Updated last year
- Code for paper: Aligning Large Language Models with Representation Editing: A Control Perspective☆35Jan 31, 2025Updated last year
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆308Jan 22, 2026Updated 6 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆68Jun 9, 2025Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆22Dec 14, 2024Updated last year
- Experiments with representation engineering☆14Feb 28, 2024Updated 2 years ago
- Code for 'The Linear Representation Hypothesis and the Geometry of Large Language Models' (ICML 2024)☆125Feb 11, 2025Updated last year
- An exploration of LLM steering☆28Jun 15, 2024Updated 2 years ago
- Official Code Repository for LM-Steer Paper: "Word Embeddings Are Steers for Language Models" (ACL 2024 Outstanding Paper Award)☆149Jul 13, 2025Updated last year
- A library for making RepE control vectors☆744Sep 24, 2025Updated 10 months ago
- Modified to support crosscoder training.☆27Jul 2, 2026Updated 3 weeks ago
- Our research proposes a novel MoGU framework that improves LLMs' safety while preserving their usability.☆18Jan 14, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LLM experiments done during SERI MATS - focusing on activation steering / interpreting activation spaces☆105Sep 21, 2023Updated 2 years ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆581Jan 28, 2025Updated last year
- Accompanying codebase for neuroscope.io, a website for displaying max activating dataset examples for language model neurons☆14Feb 13, 2023Updated 3 years ago
- Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …☆268Updated this week
- Awesome Large Reasoning Model(LRM) Safety.This repository is used to collect security-related research on large reasoning models such as …☆84Updated this week
- A survey on harmful fine-tuning attack for large language model (ACM CSUR)☆247Jun 22, 2026Updated last month
- ☆223Oct 14, 2025Updated 9 months ago