Alternatives and similar repositories for malicious-prompt-detection

Users that are interested in malicious-prompt-detection are comparing it to the libraries listed below

• invariantlabs-ai / mcp-injection-experiments
  Code snippets to reproduce MCP tool poisoning attacks.
  ☆183Updated 6 months ago
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆144Updated 2 months ago
• mitre-atlas / atlas-data
  ATLAS tactics, techniques, and case studies data
  ☆85Updated 2 weeks ago
• xashru / cti-bench
  ☆66Updated last year
• pasquini-dario / LLMmap
  ☆74Updated 3 months ago
• aiforsec / SECURE
  SECURE: Benchmarking Generative Large Language Models as a Cyber Advisory
  ☆13Updated last year
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆570Updated 8 months ago
• Valhall-ai / prompt-injection-mitigations
  A collection of prompt injection mitigation techniques.
  ☆24Updated 2 years ago
• precize / Agentic-AI-Top10-Vulnerability
  Top 10 for Agentic AI (AI Agent Security) serves as the core for OWASP and CSA Red teaming work
  ☆145Updated 3 weeks ago
• dreadnode / AIRTBench-Code
  Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models
  ☆83Updated last week
• kenhuangus / Top-Threats-for-AI-Agents
  ☆55Updated 5 months ago
• andyzorigin / cybench
  ☆165Updated 4 months ago
• trailofbits / awesome-ml-security
  ☆151Updated last month
• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆421Updated last year
• pasquini-dario / project_mantis
  Project Mantis: Hacking Back the AI-Hacker; Prompt Injection as a Defense Against LLM-driven Cyberattacks
  ☆88Updated 5 months ago
• moohax / Charcuterie
  Data Scientists Go To Jupyter
  ☆67Updated 7 months ago
• prompt-security / ps-fuzz
  Make your GenAI Apps Safe & Secure Test & harden your system prompt
  ☆579Updated last month
• TalEliyahu / Awesome-AI-Security
  Curated resources, research, and tools for securing AI systems
  ☆156Updated last week
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆114Updated last year
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆237Updated last year
• humane-intelligence / ai_village_defcon_grt_data
  ☆14Updated last year
• ReversecLabs / spikee
  ☆91Updated last week
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆32Updated last year
• kaplanlior / oss-llm-security
  Curated list of Open Source project focused on LLM security
  ☆62Updated 11 months ago
• protectai / nbdefense
  Secure Jupyter Notebooks and Experimentation Environment
  ☆84Updated 8 months ago
• mitre-atlas / arsenal
  CALDERA plugin for adversary emulation of AI-enabled systems
  ☆103Updated 2 years ago
• parameterlab / trap
  Source code of "TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identification", ACL2024 (findings)
  ☆13Updated 11 months ago
• bsinger98 / Incalmo
  ☆59Updated this week
• stratosphereips / shelLM
  Code for shelLM tool
  ☆56Updated 9 months ago
• google-research / camel-prompt-injection
  Code for the paper "Defeating Prompt Injections by Design"
  ☆138Updated 4 months ago