sherdencooper / prompt-injectionLinks
Official repo for Customized but Compromised: Assessing Prompt Injection Risks in User-Designed GPTs
☆29Updated 2 years ago
Alternatives and similar repositories for prompt-injection
Users that are interested in prompt-injection are comparing it to the libraries listed below
Sorting:
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆556Updated last year
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆443Updated last year
- The fastest Trust Layer for AI Agents☆144Updated 6 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆100Updated 10 months ago
- MCPSafetyScanner - Automated MCP safety auditing and remediation using Agents. More info: https://www.arxiv.org/abs/2504.03767☆157Updated 8 months ago
- Guardrails for secure and robust agent development☆374Updated 4 months ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆332Updated last year
- prompt attack-defense, prompt Injection, reverse engineering notes and examples | 提示词对抗、破解例子与笔记☆275Updated 10 months ago
- ☆99Updated last year
- MCP Server Semgrep is a [Model Context Protocol](https://modelcontextprotocol.io) compliant server that integrates the powerful Semgrep s…☆24Updated 9 months ago
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆55Updated last month
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆129Updated last month
- Automated Safety Testing of Large Language Models☆17Updated 10 months ago
- Static Analysis meets Large Language Models☆53Updated last year
- ☆180Updated last week
- Enhancing AI Software Engineering with Repository-level Code Graph☆237Updated 8 months ago
- CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.☆57Updated last year
- ☆54Updated last year
- The automated prompt injection framework for LLM-integrated applications.☆243Updated last year
- Whispers in the Machine: Confidentiality in Agentic Systems☆41Updated 2 weeks ago
- Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!☆341Updated 2 months ago
- Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…☆13Updated 2 years ago
- Agent Security Bench (ASB)☆157Updated last month
- This repository provides a benchmark for prompt injection attacks and defenses in LLMs☆361Updated last month
- AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks☆61Updated 7 months ago
- All about llm-agents security,attack,vulnerabilities and how to do them for cybersecurity.☆37Updated 11 months ago
- autoredteam: code for training models that automatically red team other language models☆15Updated 2 years ago
- RepairAgent is an autonomous LLM-based agent for software repair.☆79Updated 5 months ago
- An autonomous LLM-agent for large-scale, repository-level code auditing☆291Updated 3 weeks ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆33Updated last year