liu00222 / Open-Prompt-Injection

Related projects: ⓘ

• RICommunity / TAP
  TAP: An automated jailbreaking method for black-box LLMs
  ☆106Updated 6 months ago
• SheltonLiu-N / AutoDAN
  The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models".
  ☆203Updated last month
• JailbreakBench / jailbreakbench
  An Open Robustness Benchmark for Jailbreaking Language Models [arXiv 2024]
  ☆169Updated last month
• uiuc-kang-lab / InjecAgent
  ☆33Updated 2 months ago
• patrickrchao / JailbreakingLLMs
  ☆357Updated last month
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆66Updated this week
• ThuCCSLab / JailbreakEval
  A collection of automated evaluators for assessing jailbreak attempts.
  ☆55Updated 2 months ago
• BillChan226 / AgentPoison
  Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆36Updated last month
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆84Updated this week
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆181Updated last month
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆38Updated 5 months ago
• niconi19 / LLM-Conversation-Safety
  [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
  ☆65Updated last month
• facebookresearch / advprompter
  Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873
  ☆110Updated 4 months ago
• sherdencooper / GPTFuzz
  Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts
  ☆366Updated 5 months ago
• sleeepeer / PoisonedRAG
  [USENIX Security 2025] PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models
  ☆61Updated this week
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆72Updated 4 months ago
• ThuCCSLab / FigStep
  Jailbreaking Large Vision-language Models via Typographic Visual Prompts
  ☆76Updated 4 months ago
• rotaryhammer / code-autodan
  An unofficial implementation of AutoDAN attack on LLMs (arXiv:2310.15140)
  ☆27Updated 7 months ago
• centerforaisafety / HarmBench
  HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
  ☆275Updated last month
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆50Updated 6 months ago
• Aatrox103 / SAP
  ☆37Updated 4 months ago
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆45Updated last month
• Princeton-SysML / Jailbreak_LLM
  ☆143Updated 9 months ago
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆89Updated 2 months ago
• BHui97 / PLeak
  ☆22Updated 7 months ago
• LLM-Tuning-Safety / LLMs-Finetuning-Safety
  We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…
  ☆219Updated 6 months ago
• tmlr-group / DeepInception
  [arXiv:2311.03191] "DeepInception: Hypnotize Large Language Model to Be Jailbreaker"
  ☆109Updated 7 months ago
• wang2226 / Trojan-Activation-Attack
  ☆12Updated last month
• thunlp / OpenBackdoor
  An open-source toolkit for textual backdoor attack and defense (NeurIPS 2022 D&B, Spotlight)
  ☆148Updated last year
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆27Updated 5 months ago