TrustAIRLab / VoiceJailbreakAttack
Code for Voice Jailbreak Attacks Against GPT-4o.
☆26Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for VoiceJailbreakAttack
- ☆14Updated 6 months ago
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆34Updated 3 weeks ago
- JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and further assess …☆35Updated 4 months ago
- Jailbreaking Large Vision-language Models via Typographic Visual Prompts☆87Updated 6 months ago
- ☆86Updated 9 months ago
- [ECCV'24 Oral] The official GitHub page for ''Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking …☆15Updated 3 weeks ago
- [USENIX'24] Prompt Stealing Attacks Against Text-to-Image Generation Models☆24Updated last month
- Code repo of our paper Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (https://arxiv.org/abs/2406.10794…☆12Updated 3 months ago
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆44Updated last month
- ☆40Updated last year
- Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers☆36Updated 2 months ago
- [ArXiv 2024] Denial-of-Service Poisoning Attacks on Large Language Models☆13Updated 3 weeks ago
- [Arxiv 2024] Adversarial attacks on multimodal agents☆39Updated 4 months ago
- Code for the paper "BadPrompt: Backdoor Attacks on Continuous Prompts"☆36Updated 4 months ago
- ☆53Updated 3 weeks ago
- SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal Behaviors☆34Updated 4 months ago
- Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT☆25Updated last year
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆46Updated 3 months ago
- ☆13Updated last month
- A curated list of trustworthy Generative AI papers. Daily updating...☆67Updated 2 months ago
- AnyDoor: Test-Time Backdoor Attacks on Multimodal Large Language Models☆44Updated 7 months ago
- Code for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder" in NMI.☆43Updated last year
- Accepted by ECCV 2024☆74Updated last month
- AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM☆45Updated 2 weeks ago
- ☆26Updated 4 months ago
- Repo for the research paper "Aligning LLMs to Be Robust Against Prompt Injection"☆19Updated 3 weeks ago
- ☆24Updated 5 months ago
- Code to conduct an embedding attack on LLMs☆19Updated last month
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆48Updated 3 months ago
- [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion☆29Updated 3 weeks ago