sinanw / llm-security-prompt-injectionLinks
This project investigates the security of large language models by performing binary classification of a set of input prompts to discover malicious prompts. Several approaches have been analyzed using classical ML algorithms, a trained LLM model, and a fine-tuned LLM model.
☆43Updated last year
Alternatives and similar repositories for llm-security-prompt-injection
Users that are interested in llm-security-prompt-injection are comparing it to the libraries listed below
Sorting:
- The fastest Trust Layer for AI Agents☆140Updated 2 months ago
- A benchmark for prompt injection detection systems.☆124Updated 2 weeks ago
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆400Updated last year
- This repository provides a benchmark for prompt Injection attacks and defenses☆250Updated 2 weeks ago
- LLM security and privacy☆49Updated 9 months ago
- Papers about red teaming LLMs and Multimodal models.☆130Updated 2 months ago
- ☆127Updated last month
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆113Updated last year
- Risks and targets for assessing LLMs & LLM vulnerabilities☆32Updated last year
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆226Updated last week
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆165Updated 4 months ago
- ☆588Updated last month
- A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.☆340Updated this week
- Dropbox LLM Security research code and results☆231Updated last year
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆399Updated last year
- A collection of prompt injection mitigation techniques.☆23Updated last year
- Payloads for Attacking Large Language Models☆92Updated 2 months ago
- Learn about a type of vulnerability that specifically targets machine learning models☆314Updated last year
- LMAP (large language model mapper) is like NMAP for LLM, is an LLM Vulnerability Scanner and Zero-day Vulnerability Fuzzer.☆22Updated 9 months ago
- ☆70Updated last year
- Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"☆44Updated 10 months ago
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆73Updated last year
- ☆81Updated 8 months ago
- Red-Teaming Language Models with DSPy☆203Updated 5 months ago
- Top 10 for Agentic AI (AI Agent Security) serves as the core for OWASP and CSA Red teaming work☆124Updated last month
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆324Updated 6 months ago
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆530Updated this week
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆303Updated last year
- Every practical and proposed defense against prompt injection.☆503Updated 5 months ago
- Implementation of BEAST adversarial attack for language models (ICML 2024)☆89Updated last year