A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
☆160Apr 15, 2024Updated 2 years ago
Alternatives and similar repositories for BIPIA
Users that are interested in BIPIA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries☆78Nov 10, 2025Updated 11 months ago
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆102Jul 2, 2026Updated 3 months ago
- Repo for the paper "Defending Against Prompt Injection With a Few DefensiveTokens"☆19Nov 10, 2025Updated 11 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆904Jun 2, 2026Updated 4 months ago
- This repository provides a benchmark for prompt injection attacks and defenses in LLMs☆504Sep 27, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Every practical and proposed defense against prompt injection.☆737Feb 22, 2025Updated last year
- ☆172Jul 2, 2024Updated 2 years ago
- [ACL 2025] The official implementation of the paper "PIGuard: Prompt Injection Guardrail via Mitigating Overdefense for Free".☆87Dec 4, 2025Updated 10 months ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆96Sep 1, 2025Updated last year
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆75Oct 23, 2024Updated last year
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆687Apr 4, 2025Updated last year
- Code to conduct an embedding attack on LLMs☆34Jan 10, 2025Updated last year
- [NeurIPS 2025] The official implementation of the paper "DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agen…☆61Jul 16, 2026Updated 2 months ago
- Code to generate NeuralExecs (prompt injection for LLMs)☆27Oct 5, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A collection of prompt injection mitigation techniques.☆28Aug 19, 2023Updated 3 years ago
- Code for our NAACL2025 accepted paper: Attention Tracker: Detecting Prompt Injection Attacks in LLMs☆33Sep 19, 2025Updated last year
- Code for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder" in NMI.☆57Nov 13, 2023Updated 2 years ago
- A benchmark for prompt injection detection systems.☆199Apr 16, 2026Updated 5 months ago
- Code for Voice Jailbreak Attacks Against GPT-4o.☆40May 31, 2024Updated 2 years ago
- ☆15Nov 29, 2025Updated 10 months ago
- ASIDE: Architectural Separation of Instructions and Data in Language Models [ICLR 2026]☆18Jun 10, 2026Updated 4 months ago
- This is the official repository for Cross-modality Information Check for Detecting Jailbreaking in Multimodal Large Language Models.☆17Jan 16, 2025Updated last year
- An LLM can Fool Itself: A Prompt-Based Adversarial Attack (ICLR 2024)☆117Jan 21, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [COLM 2024] JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and fur…☆99May 9, 2025Updated last year
- Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models☆37Oct 6, 2025Updated last year
- Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs☆139Dec 2, 2024Updated last year
- Utilities for Python developing and debugging.☆25Dec 1, 2021Updated 4 years ago
- [EMNLP 2026] PISanitizer: Preventing Prompt Injection to Long-Context LLMs via Prompt Sanitization☆20Aug 21, 2026Updated last month
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆1,064Aug 16, 2024Updated 2 years ago
- The automated prompt injection framework for LLM-integrated applications.☆276Sep 12, 2024Updated 2 years ago
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆117Sep 27, 2024Updated 2 years ago
- [ICML 2026] Official implementation for paper "Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Ag…☆38Jul 31, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆167Nov 30, 2024Updated last year
- An unofficial implementation of AutoDAN attack on LLMs (arXiv:2310.15140)☆46Feb 8, 2024Updated 2 years ago
- A fast + lightweight implementation of the GCG algorithm in PyTorch☆356May 13, 2025Updated last year
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆924Sep 1, 2026Updated last month
- Jailbreak artifacts for JailbreakBench☆113Nov 6, 2024Updated last year
- Code and data for our paper "Are You Copying My Model? Protecting the Copyright of Large Language Models for EaaS via Backdoor Watermark"…☆52Jul 11, 2023Updated 3 years ago
- Official implementation of the WASP web agent security benchmark☆97Apr 13, 2026Updated 5 months ago