prompt-security / ps-fuzz

Related projects: ⓘ

• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆299Updated 7 months ago
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆210Updated 3 months ago
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆310Updated 3 months ago
• RiccardoBiosas / awesome-MLSecOps
  A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
  ☆220Updated last month
• protectai / modelscan
  Protection against Model Serialization Attacks
  ☆273Updated this week
• tenable / awesome-llm-cybersecurity-tools
  A curated list of large language model tools for cybersecurity research.
  ☆376Updated 5 months ago
• OWASP / www-project-top-10-for-large-language-model-applications
  OWASP Foundation Web Respository
  ☆504Updated last week
• leondz / garak
  LLM vulnerability scanner
  ☆1,273Updated this week
• protectai / rebuff
  LLM Prompt Injection Detector
  ☆1,067Updated last month
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆218Updated 7 months ago
• ipa-lab / hackingBuddyGPT
  Helping Ethical Hackers use LLMs in 50 Lines of Code or less..
  ☆392Updated 2 weeks ago
• OWASP / www-project-ai-security-and-privacy-guide
  OWASP Foundation Web Respository
  ☆199Updated last month
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆80Updated last week
• protectai / llm-guard
  The Security Toolkit for LLM Interactions
  ☆1,131Updated this week
• usnistgov / dioptra
  Test Software for the Characterization of AI Technologies
  ☆212Updated this week
• openai / openai-security-bots
  ☆344Updated 5 months ago
• jthack / PIPE
  Prompt Injection Primer for Engineers
  ☆348Updated last year
• WithSecureLabs / damn-vulnerable-llm-agent
  ☆164Updated 8 months ago
• ottosulin / awesome-ai-security
  A collection of awesome resources related AI security
  ☆107Updated 5 months ago
• dhammon / ai-goat
  Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.
  ☆147Updated 3 weeks ago
• latiotech / LAST
  Use AI to Scan Your Code from the Command Line for security and code smells. Bring your own keys. Supports OpenAI and Gemini
  ☆143Updated 6 months ago
• mrwadams / stride-gpt
  An AI-powered threat modeling tool that leverages OpenAI's GPT models to generate threat models for a given application based on the STRI…
  ☆392Updated 3 weeks ago
• Seezo-io / llm-security-101
  Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.
  ☆143Updated 11 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆103Updated 6 months ago
• merlinn-co / merlinn
  Open source AI on-call developer 🧙‍♂️ Get relevant context & root cause analysis in seconds about production incidents and make on-call …
  ☆241Updated this week
• forcesunseen / llm-hackers-handbook
  A guide to LLM hacking: fundamentals, prompt injection, offense, and defense
  ☆112Updated last year
• utkusen / promptmap
  automatically tests prompt injection attacks on ChatGPT instances
  ☆612Updated 9 months ago
• msoedov / agentic_security
  Agentic LLM Vulnerability Scanner / AI red teaming kit
  ☆684Updated last week
• cybershujin / Threat-Actors-use-of-Artifical-Intelligence
  ☆158Updated last month
• genia-dev / vibraniumdome
  ☆38Updated this week