sherdencooper / prompt-injectionLinks
Official repo for Customized but Compromised: Assessing Prompt Injection Risks in User-Designed GPTs
☆29Updated last year
Alternatives and similar repositories for prompt-injection
Users that are interested in prompt-injection are comparing it to the libraries listed below
Sorting:
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆530Updated 11 months ago
- The fastest Trust Layer for AI Agents☆144Updated 3 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆420Updated last year
- Guardrails for secure and robust agent development☆344Updated last month
- MCPSafetyScanner - Automated MCP safety auditing and remediation using Agents. More info: https://www.arxiv.org/abs/2504.03767☆128Updated 5 months ago
- prompt attack-defense, prompt Injection, reverse engineering notes and examples | 提示词对抗、破解例子与笔记☆232Updated 6 months ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆315Updated last year
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆91Updated 7 months ago
- ☆148Updated 3 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆40Updated this week
- This repository provides a benchmark for prompt Injection attacks and defenses☆284Updated 2 months ago
- Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…☆13Updated 2 years ago
- 😎 Awesome list of resources about using and building AI software development systems☆112Updated last year
- 🚀 The LLM Automatic Computer Framework: L2MAC☆136Updated 8 months ago
- Tools and our test data developed for the HackAPrompt 2023 competition☆44Updated last year
- ☆79Updated last year
- AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks☆55Updated 3 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆97Updated 3 weeks ago
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆41Updated 2 months ago
- Enhancing AI Software Engineering with Repository-level Code Graph☆214Updated 5 months ago
- A powerful MCP (Model Context Protocol) Server that audits npm package dependencies for security vulnerabilities. Built with remote npm r…☆47Updated 2 months ago
- MCP Bridge is a lightweight, fast, and LLM-agnostic proxy for connecting to multiple Model Context Protocol (MCP) servers through a unifi…☆38Updated 2 months ago
- DeepTeam is a framework to red team LLMs and LLM systems.☆705Updated this week
- Whispers in the Machine: Confidentiality in Agentic Systems☆41Updated 2 weeks ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆32Updated last year
- ☆73Updated 11 months ago
- The automated prompt injection framework for LLM-integrated applications.☆228Updated last year
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆275Updated 2 weeks ago
- A benchmark for prompt injection detection systems.☆136Updated 3 weeks ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆183Updated 9 months ago