FonduAI / awesome-prompt-injection
Learn about a type of vulnerability that specifically targets machine learning models
☆166Updated 3 months ago
Related projects: ⓘ
- Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.☆143Updated 11 months ago
- A collection of awesome resources related AI security☆107Updated 5 months ago
- ☆164Updated 8 months ago
- A LLM explicitly designed for getting hacked☆121Updated last year
- Prompt Injections Everywhere☆68Updated last month
- Prompt Injection Primer for Engineers☆348Updated last year
- Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.☆147Updated 3 weeks ago
- A guide to LLM hacking: fundamentals, prompt injection, offense, and defense☆112Updated last year
- some prompt about cyber security☆137Updated last year
- A curated list of large language model tools for cybersecurity research.☆376Updated 5 months ago
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆299Updated 7 months ago
- Every practical and proposed defense against prompt injection.☆310Updated 3 months ago
- Dropbox LLM Security research code and results☆210Updated 3 months ago
- Payloads for Attacking Large Language Models☆56Updated 2 months ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆218Updated 7 months ago
- A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.☆220Updated last month
- CTF challenges designed and implemented in machine learning applications☆99Updated 3 weeks ago
- A benchmark for prompt injection detection systems.☆80Updated last week
- OWASP Machine Learning Security Top 10 Project☆69Updated last week
- A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.☆538Updated 2 months ago
- automatically tests prompt injection attacks on ChatGPT instances☆612Updated 9 months ago
- an extension for Burp Suite to allow researchers to utilize GPT for analys is of HTTP requests and responses☆89Updated last year
- ☆158Updated last month
- ☆357Updated last month
- OWASP Foundation Web Respository☆504Updated last week
- SourceGPT - prompt manager and source code analyzer built on top of ChatGPT as the oracle☆105Updated last year
- The notebook for my talk - ChatGPT: Your Red Teaming Ally☆39Updated last year
- This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses☆125Updated 2 weeks ago
- OWASP Foundation Web Respository☆199Updated last month
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆103Updated 6 months ago