Alternatives and similar repositories for PromptInject:

Users that are interested in PromptInject are comparing it to the libraries listed below

• RICommunity / TAP
  TAP: An automated jailbreaking method for black-box LLMs
  ☆145Updated 2 months ago
• patrickrchao / JailbreakingLLMs
  ☆497Updated 2 months ago
• sherdencooper / GPTFuzz
  Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts
  ☆450Updated 4 months ago
• SheltonLiu-N / AutoDAN
  [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…
  ☆291Updated 3 weeks ago
• liu00222 / Open-Prompt-Injection
  This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
  ☆172Updated 3 weeks ago
• CHATS-lab / persuasive_jailbreaker
  Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!
  ☆283Updated 4 months ago
• JailbreakBench / jailbreakbench
  JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]
  ☆297Updated 4 months ago
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]
  ☆262Updated 3 weeks ago
• ThuCCSLab / JailbreakEval
  [NDSS'25 Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆110Updated this week
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆96Updated 2 months ago
• haizelabs / redteaming-resistance-benchmark
  ☆39Updated 6 months ago
• hwchase17 / adversarial-prompts
  Curation of prompts that are known to be adversarial to large language models
  ☆179Updated 2 years ago
• LLM-Tuning-Safety / LLMs-Finetuning-Safety
  We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…
  ☆276Updated 11 months ago
• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆350Updated last year
• chawins / llm-sp
  Papers and resources related to the security and privacy of LLMs 🤖
  ☆478Updated 2 months ago
• GraySwanAI / circuit-breakers
  Improving Alignment and Robustness with Circuit Breakers
  ☆185Updated 4 months ago
• haizelabs / dspy-redteam
  Red-Teaming Language Models with DSPy
  ☆168Updated last week
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆47Updated 4 months ago
• AI-secure / DecodingTrust
  A Comprehensive Assessment of Trustworthiness in GPT Models
  ☆274Updated 5 months ago
• centerforaisafety / HarmBench
  HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal
  ☆541Updated 6 months ago
• GraySwanAI / nanoGCG
  A fast + lightweight implementation of the GCG algorithm in PyTorch
  ☆178Updated last week
• NJUNLP / ReNeLLM
  The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…
  ☆92Updated 3 weeks ago
• WhileBug / AwesomeLLMJailBreakPapers
  Awesome LLM Jailbreak academic papers
  ☆90Updated last year
• facebookresearch / advprompter
  Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873
  ☆140Updated 9 months ago
• BHui97 / PLeak
  ☆51Updated 2 months ago
• Princeton-SysML / Jailbreak_LLM
  ☆163Updated last year
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆96Updated 2 weeks ago
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆388Updated 8 months ago
• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆58Updated 10 months ago
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆117Updated 7 months ago