Alternatives and similar repositories for prompt-stealing-attack:

Users that are interested in prompt-stealing-attack are comparing it to the libraries listed below

• WUSTL-CSPL / LLMJailbreak
  ☆31Updated 7 months ago
• papersPapers / BadPrompt
  Code for the paper "BadPrompt: Backdoor Attacks on Continuous Prompts"
  ☆36Updated 9 months ago
• PKU-ML / PAT
  Code for NeurIPS 2024 Paper "Fight Back Against Jailbreaking via Prompt Adversarial Tuning"
  ☆12Updated 6 months ago
• qingjiesjtu / USC
  This is the code repository of our submission: Understanding the Dark Side of LLMs’ Intrinsic Self-Correction.
  ☆56Updated 4 months ago
• Lyz1213 / BadEdit
  ☆26Updated 6 months ago
• wanlunsec / Beatrix
  ☆24Updated 2 years ago
• thu-ml / Attack-Bard
  ☆95Updated last year
• KuofengGao / Verbose_Images
  [ICLR 2024] Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images
  ☆33Updated last year
• jinyuan-jia / BadEncoder
  ☆81Updated 3 years ago
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆71Updated 8 months ago
• grasses / PoisonPrompt
  Code for paper: PoisonPrompt: Backdoor Attack on Prompt-based Large Language Models, IEEE ICASSP 2024. Demo//124.220.228.133:11107
  ☆17Updated 8 months ago
• pasquini-dario / LLM_NeuralExec
  Code to generate NeuralExecs (prompt injection for LLMs)
  ☆20Updated 5 months ago
• lancopku / codable-watermarking-for-llm
  Repository for Towards Codable Watermarking for Large Language Models
  ☆36Updated last year
• AI-secure / MMDT
  Comprehensive Assessment of Trustworthiness in Multimodal Foundation Models
  ☆18Updated last month
• reds-lab / ASSET
  This repository is the official implementation of the paper "ASSET: Robust Backdoor Data Detection Across a Multiplicity of Deep Learning…
  ☆17Updated last year
• thunxxx / MLLM-Jailbreak-evaluation-MMJ-Bench
  ☆41Updated last month
• ChenWu98 / agent-attack
  [ICLR 2025] Dissecting Adversarial Robustness of Multimodal LM Agents
  ☆82Updated 2 months ago
• xirui-li / DrAttack
  Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers
  ☆52Updated 8 months ago
• Sizhe-Chen / StruQ
  official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries
  ☆33Updated 2 weeks ago
• abc03570128 / Jailbreaking-Attack-against-Multimodal-Large-Language-Model
  ☆44Updated 8 months ago
• LLMSecurity / MasterKey
  MASTERKEY is a framework designed to explore and exploit vulnerabilities in large language model chatbots by automating jailbreak attacks…
  ☆21Updated 7 months ago
• Testing4AI / DeepJudge
  Code release for DeepJudge (S&P'22)
  ☆51Updated 2 years ago
• yuplin2333 / representation-space-jailbreak
  Code repo of our paper Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (https://arxiv.org/abs/2406.10794…
  ☆19Updated 9 months ago
• ydc123 / MMP-Attack
  Official repository for "On the Multi-modal Vulnerability of Diffusion Models"
  ☆16Updated 9 months ago
• ThuCCSLab / FigStep
  [AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts
  ☆135Updated 2 months ago
• xiaojunxu / learning-to-watermark-llm
  ☆18Updated last year
• Eyr3 / TextCRS
  Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks (IEEE S&P 2024)
  ☆33Updated 2 weeks ago
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆72Updated 7 months ago
• AI45Lab / CodeAttack
  [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion
  ☆38Updated 6 months ago
• zihao-ai / BoT
  🔥🔥🔥Breaking long thought processes of o1-like LLMs, such as DeepSeek-R1, QwQ
  ☆28Updated 2 months ago