PISmith: Reinforcement Learning-based Red Teaming for Prompt Injection Defenses
☆22Jul 17, 2026Updated 2 weeks ago
Alternatives and similar repositories for PISmith
Users that are interested in PISmith are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ACL 2026] PIArena: A Platform for Prompt Injection Evaluation☆41Apr 28, 2026Updated 3 months ago
- Official release of code for the paper RL is a hammer and LLMs are nails A simple RL approach to stronger prompt injection attacks☆53May 6, 2026Updated 2 months ago
- ☆18Mar 25, 2026Updated 4 months ago
- [S&P 2026] SoK: Evaluating Jailbreak Guardrails for Large Language Models☆46Dec 17, 2025Updated 7 months ago
- ☆21Jun 12, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆22Dec 18, 2025Updated 7 months ago
- Evaluating Safety of Autonomous Agents in Mobile Device Control (AAAI 2026 AI Alignment Track)☆36Jan 28, 2026Updated 6 months ago
- [ICML'25] MELON: Provable Defense Against Indirect Prompt Injection Attacks in AI Agents☆37Jul 31, 2025Updated last year
- [NeurIPS 2025] The official implementation of the paper "DRIFT: Dynamic Rule-Based Defense with Injection Isolation for Securing LLM Agen…☆59Jul 16, 2026Updated 3 weeks ago
- ☆155Jul 2, 2024Updated 2 years ago
- [ICLR'26] Building a Foundational Guardrail for General Agentic Systems via Synthetic Data☆48Oct 26, 2025Updated 9 months ago
- ☆25May 28, 2025Updated last year
- [ICLR 2026] Official implementation of "ChatInject: Abusing Chat Templates for Prompt Injection in LLM Agents"☆19Mar 23, 2026Updated 4 months ago
- Official implementation of the WASP web agent security benchmark☆98Apr 13, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- code of paper "Defending Against Alignment-Breaking Attacks via Robustly Aligned LLM"☆14Nov 17, 2023Updated 2 years ago
- [ICML 2026] Official implementation for paper "Unsafer in Many Turns: Benchmarking and Defending Multi-Turn Safety Risks in Tool-Using Ag…☆30Updated this week
- ☆17Mar 9, 2025Updated last year
- ☆30Jun 13, 2026Updated last month
- Agent Skills Enable a New Class of Realistic and Trivially Simple Prompt Injections☆22Jul 2, 2026Updated last month
- Agent Security Bench (ASB)☆274Apr 16, 2026Updated 3 months ago
- Official code for our paper "SoK: Large Language Model Copyright Auditing via Fingerprinting"☆18Dec 31, 2025Updated 7 months ago
- [EMNLP 2025 Oral] IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents☆22Sep 16, 2025Updated 10 months ago
- [NeurIPS 2025] Taught Well Learned Ill: Towards Distillation-conditional Backdoor Attack☆15Nov 19, 2025Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆39Mar 12, 2025Updated last year
- [ACL 2025] The official code for "AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection".☆43Aug 4, 2025Updated last year
- ☆12Feb 19, 2024Updated 2 years ago
- The official code for "Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks".☆18Jun 24, 2026Updated last month
- [ICLR 2026 Oral] Invisible Safety Threat: Malicious Finetuning for LLM via Steganography☆20Mar 22, 2026Updated 4 months ago
- ☆73Jun 18, 2026Updated last month
- SkillGrad: Optimizing Agent Skills Like Gradient Descent☆24May 28, 2026Updated 2 months ago
- [ICML 2026] Official implementations of ``SafeSearch: Automated Red-Teaming of LLM-Based Search Agents''☆19Mar 25, 2026Updated 4 months ago
- PFI: Prompt Flow Integrity to Prevent Privilege Escalation in LLM Agents☆31Mar 26, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [AAAI 2026] This is the official implementation of the paper "ExtendAttack: Attacking Servers of LRMs via Extending Reasoning".☆25Mar 18, 2026Updated 4 months ago
- Internal Consistency Regularization (CROW) for LLM Backdoor Elimination - Paper accepted to ICML 2025☆16May 6, 2025Updated last year
- [AAAI 2026] The official code for ``LoopLLM: Transferable Energy-Latency Attacks in LLMs via Repetitive Generation''☆17Mar 20, 2026Updated 4 months ago
- Attribute statements generated by LLMs to preceding tokens using attention weights.☆28Apr 22, 2025Updated last year
- Implement of Implicit Knowledge Extraction Attack.☆24Jul 14, 2026Updated 3 weeks ago
- [ICML 2024] Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast☆124Mar 26, 2024Updated 2 years ago
- Official implementation of the USENIX Security 2024 paper ModelGuard: Information-Theoretic Defense Against Model Extraction Attacks.☆25Dec 6, 2023Updated 2 years ago