Zhang-Yihao / Adversarial-Representation-EngineeringLinks
Official implementation repository for the paper Towards General Conceptual Model Editing via Adversarial Representation Engineering.
☆18Updated last year
Alternatives and similar repositories for Adversarial-Representation-Engineering
Users that are interested in Adversarial-Representation-Engineering are comparing it to the libraries listed below
Sorting:
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆98Updated last year
- ☆27Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆126Updated 11 months ago
- ☆44Updated last year
- Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep☆170Updated 9 months ago
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆89Updated 10 months ago
- Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks☆32Updated last year
- Data and code for the paper: Finding Safety Neurons in Large Language Models☆20Updated this week
- Code and dataset for the paper: "Can Editing LLMs Inject Harm?"☆21Updated last month
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆65Updated last year
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆74Updated 11 months ago
- ☆32Updated 10 months ago
- [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models☆92Updated 9 months ago
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding☆153Updated last year
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆66Updated 7 months ago
- ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆93Updated last year
- ☆23Updated last year
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆71Updated 8 months ago
- This repo is for the safety topic, including attacks, defenses and studies related to reasoning and RL☆59Updated 4 months ago
- Code for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder" in NMI.☆56Updated 2 years ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆49Updated 2 weeks ago
- This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)☆25Updated last year
- [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents☆123Updated 11 months ago
- ☆72Updated last year
- A resource repository for representation engineering in large language models☆148Updated last year
- [ICLR 2025] General-purpose activation steering library☆138Updated 4 months ago
- [EMNLP 2025 Main] ConceptVectors Benchmark and Code for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces"☆40Updated 5 months ago
- [NeurIPS25] Official repo for "Simplicity Prevails: Rethinking Negative Preference Optimization for LLM Unlearning"☆40Updated 3 months ago
- The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…☆73Updated last year
- This is the official code for the paper "Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable".☆28Updated 10 months ago