[CIKM 2024] Trojan Activation Attack: Attack Large Language Models using Activation Steering for Safety-Alignment.
☆30Jul 29, 2024Updated 2 years ago
Alternatives and similar repositories for Trojan-Activation-Attack
Users that are interested in Trojan-Activation-Attack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [EMNLP 2023] Explainable Claim Verification via Knowledge-Grounded Reasoning with Large Language Models☆28Dec 13, 2023Updated 2 years ago
- ☆27Feb 28, 2023Updated 3 years ago
- Code and dataset for the paper: "Can Editing LLMs Inject Harm?" [AAAI'26]☆21Dec 26, 2025Updated 10 months ago
- ☆36Feb 27, 2025Updated last year
- Röttger et al (ACL 2024): "Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Lang…☆14Feb 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for the paper "Self-Detoxifying Language Models via Toxification Reversal" (EMNLP 2023)☆19Oct 17, 2023Updated 3 years ago
- [ICLR'26, NAACL'25 Demo] Toolkit & Benchmark for evaluating the trustworthiness of generative foundation models.☆136Oct 20, 2026Updated 2 weeks ago
- ☆27Jun 27, 2024Updated 2 years ago
- [ICLR24] Official Repo of BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models☆57Jul 24, 2024Updated 2 years ago
- Unofficial implementation of "Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection"☆27Jul 6, 2024Updated 2 years ago
- [NeurIPS 2025] BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models☆338Sep 8, 2026Updated 2 months ago
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆118Sep 27, 2024Updated 2 years ago
- Official Code for "Baseline Defenses for Adversarial Attacks Against Aligned Language Models"☆35Oct 26, 2023Updated 3 years ago
- Precision Knowledge Editing (PKE): A novel method to reduce toxicity in LLMs while preserving performance, with robust evaluations and ha…☆14Nov 26, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code to generate NeuralExecs (prompt injection for LLMs)☆27Oct 5, 2025Updated last year
- [MM'23 Oral] "Text-to-image diffusion models can be easily backdoored through multimodal data poisoning"☆31Jun 10, 2026Updated 4 months ago
- Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models☆35Oct 19, 2023Updated 3 years ago
- Finetune LLaMA-2-7b-chat to perform safety evaluation of user-bot conversation☆11Jun 2, 2025Updated last year
- Internalizing steering vectors via fine tuning☆12Sep 6, 2024Updated 2 years ago
- ☆60Jun 13, 2024Updated 2 years ago
- Backdooring Multimodal Learning☆30May 4, 2023Updated 3 years ago
- code of paper "Defending Against Alignment-Breaking Attacks via Robustly Aligned LLM"☆14Nov 17, 2023Updated 2 years ago
- Welcome to the official repository for Siren, a project aimed at understanding and mitigating harmful behaviors in large language models …☆15Jun 14, 2026Updated 4 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 大厂员工，手把手教你开发一个高并发、高可用的营销活动☆10Oct 10, 2024Updated 2 years ago
- ☆18Jun 4, 2025Updated last year
- Implementation of paper 'Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference' [NeurIPS'24…☆26Jun 14, 2024Updated 2 years ago
- RePO: Replay-Enhanced Policy Optimization☆25Jun 12, 2025Updated last year
- Code for "Backdoor Attacks on Dense Passage Retrievers for Disseminating Misinformation"☆10Nov 11, 2025Updated 11 months ago
- Röttger et al. (2025): "MSTS: A Multimodal Safety Test Suite for Vision-Language Models"☆21Mar 31, 2025Updated last year
- ☆23Oct 25, 2024Updated 2 years ago
- ☆13Jan 14, 2025Updated last year
- Kim, J., Evans, J., & Schein, A. (2025). Linear Representations of Political Perspective Emerge in Large Language Models. ICLR.☆26Mar 27, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- LLM Self Defense: By Self Examination, LLMs know they are being tricked☆53May 21, 2024Updated 2 years ago
- ☆10Jan 27, 2026Updated 9 months ago
- Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimization☆51Jul 28, 2024Updated 2 years ago
- ☆13Oct 3, 2025Updated last year
- ☆31Jul 14, 2023Updated 3 years ago
- [ACL 2026] ExpSeek: Self-Triggered Experience Seeking for Web Agents☆11Jun 30, 2026Updated 4 months ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆361Feb 23, 2024Updated 2 years ago