PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. 🏆 Best Paper Awards @ NeurIPS ML Safety Workshop 2022
☆455Feb 26, 2024Updated 2 years ago
Alternatives and similar repositories for PromptInject
Users that are interested in PromptInject are comparing it to the libraries listed below
Sorting:
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆568Updated this week
- New ways of breaking app-integrated LLMs☆2,053Jul 17, 2025Updated 7 months ago
- Universal and Transferable Attacks on Aligned Language Models☆4,521Aug 2, 2024Updated last year
- This repository provides a benchmark for prompt injection attacks and defenses in LLMs☆395Oct 29, 2025Updated 4 months ago
- A curation of awesome tools, documents and projects about LLM Security.☆1,530Aug 20, 2025Updated 6 months ago
- the LLM vulnerability scanner☆7,088Updated this week
- Curation of prompts that are known to be adversarial to large language models☆189Feb 12, 2023Updated 3 years ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆344Feb 12, 2024Updated 2 years ago
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…☆430Jan 22, 2025Updated last year
- ☆698Jul 2, 2025Updated 8 months ago
- The automated prompt injection framework for LLM-integrated applications.☆254Sep 12, 2024Updated last year
- LLM Prompt Injection Detector☆1,423Aug 7, 2024Updated last year
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆864Aug 16, 2024Updated last year
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆458Jan 31, 2024Updated 2 years ago
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆635Feb 16, 2026Updated last week
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆108Mar 8, 2024Updated last year
- Papers and resources related to the security and privacy of LLMs 🤖☆566Jun 8, 2025Updated 8 months ago
- Dropbox LLM Security research code and results☆255May 21, 2024Updated last year
- The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and eng…☆3,468Updated this week
- autoredteam: code for training models that automatically red team other language models☆15Aug 9, 2023Updated 2 years ago
- The Security Toolkit for LLM Interactions☆2,584Dec 15, 2025Updated 2 months ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆33May 27, 2024Updated last year
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆377Jan 23, 2025Updated last year
- [Preprint] On the Effectiveness of Mitigating Data Poisoning Attacks with Gradient Shaping☆10Feb 27, 2020Updated 6 years ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆341Feb 23, 2024Updated 2 years ago
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆69Oct 23, 2024Updated last year
- TAP: An automated jailbreaking method for black-box LLMs☆221Dec 10, 2024Updated last year
- using ML models for red teaming☆42Aug 9, 2023Updated 2 years ago
- Code to generate NeuralExecs (prompt injection for LLMs)☆27Oct 5, 2025Updated 4 months ago
- Every practical and proposed defense against prompt injection.☆642Feb 22, 2025Updated last year
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆815Mar 27, 2025Updated 11 months ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,816Jun 17, 2025Updated 8 months ago
- A framework to evaluate the generalization capability of safety alignment for LLMs☆624Oct 9, 2025Updated 4 months ago
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆57Aug 17, 2024Updated last year
- ☆196Nov 26, 2023Updated 2 years ago
- Prompts Methods to find the vulnerabilities in Generative Models☆20Feb 23, 2023Updated 3 years ago
- Implementation of BEAST adversarial attack for language models (ICML 2024)☆90May 14, 2024Updated last year
- Code for paper "Poisoned classifiers are not only backdoored, they are fundamentally broken"☆26Jan 7, 2022Updated 4 years ago
- Protection against Model Serialization Attacks☆646Feb 18, 2026Updated last week