Alternatives and similar repositories for prompt-stealing-attack

Users that are interested in prompt-stealing-attack are comparing it to the libraries listed below

• qingjiesjtu / USC
  This is the code repository of our submission: Understanding the Dark Side of LLMs’ Intrinsic Self-Correction.
  ☆63Updated last year
• Gwinhen / DRUPE
  Distribution Preserving Backdoor Attack in Self-supervised Learning
  ☆20Updated last year
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆75Updated last year
• WUSTL-CSPL / LLMJailbreak
  ☆37Updated last year
• XuanChen-xc / RLbreaker
  Code for "When LLM Meets DRL: Advancing Jailbreaking Efficiency via DRL-guided Search" (NeurIPS 2024)
  ☆17Updated last year
• Eyr3 / TextCRS
  Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks (IEEE S&P 2024)
  ☆34Updated 6 months ago
• CryptoAILab / misalignment
  [NDSS'25] The official implementation of safety misalignment.
  ☆17Updated last year
• jinyuan-jia / BadEncoder
  ☆84Updated 4 years ago
• Sizhe-Chen / StruQ
  official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries
  ☆59Updated 2 months ago
• Lyz1213 / BadEdit
  ☆37Updated last year
• PurduePAML / DBS
  ☆18Updated 3 years ago
• LLMSecurity / MasterKey
  MASTERKEY is a framework designed to explore and exploit vulnerabilities in large language model chatbots by automating jailbreak attacks…
  ☆29Updated last year
• grasses / PromptCARE
  Code for paper: "PromptCARE: Prompt Copyright Protection by Watermark Injection and Verification", IEEE S&P 2024.
  ☆34Updated last year
• lancopku / codable-watermarking-for-llm
  Repository for Towards Codable Watermarking for Large Language Models
  ☆38Updated 2 years ago
• Testing4AI / DeepJudge
  Code release for DeepJudge (S&P'22)
  ☆52Updated 2 years ago
• KaiyuanZh / SOFT
  [USENIX Security 2025] SOFT: Selective Data Obfuscation for Protecting LLM Fine-tuning against Membership Inference Attacks
  ☆16Updated 3 months ago
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆105Updated last year
• SCLBD / DBD
  ☆32Updated 3 years ago
• wagner-group / MarkMyWords
  ☆32Updated last year
• AI-secure / Meta-Nerual-Trojan-Detection
  ☆68Updated 5 years ago
• pasquini-dario / LLM_NeuralExec
  Code to generate NeuralExecs (prompt injection for LLMs)
  ☆26Updated 3 months ago
• bboylyg / RNP
  Reconstructive Neuron Pruning for Backdoor Defense (ICML 2023)
  ☆39Updated 2 years ago
• Gwinhen / BackdoorVault
  A toolbox for backdoor attacks.
  ☆22Updated 2 years ago
• KaiyuanZh / OrthogLinearBackdoor
  [Oakland 2024] Exploring the Orthogonality and Linearity of Backdoor Attacks
  ☆26Updated 8 months ago
• BHui97 / PLeak
  ☆75Updated last year
• wanlunsec / Beatrix
  ☆27Updated 2 years ago
• AI-secure / AdvAgent
  ☆20Updated 7 months ago
• Unispac / Fight-Poison-With-Poison
  Code repository for the paper --- [USENIX Security 2023] Towards A Proactive ML Approach for Detecting Backdoor Poison Samples
  ☆30Updated 2 years ago
• iliaishacked / sponge_examples
  ☆26Updated 4 years ago
• SolidShen / RIPPLE_official
  ☆20Updated last year