ottosulin / awesome-ai-security

Related projects: ⓘ

• OWASP / www-project-machine-learning-security-top-10
  OWASP Machine Learning Security Top 10 Project
  ☆69Updated last week
• Seezo-io / llm-security-101
  Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.
  ☆143Updated 11 months ago
• harishsg993010 / DamnVulnerableLLMProject
  A LLM explicitly designed for getting hacked
  ☆121Updated last year
• FonduAI / awesome-prompt-injection
  Learn about a type of vulnerability that specifically targets machine learning models
  ☆166Updated 3 months ago
• WithSecureLabs / damn-vulnerable-llm-agent
  ☆164Updated 8 months ago
• OWASP / www-project-ai-security-and-privacy-guide
  OWASP Foundation Web Respository
  ☆199Updated last month
• cybershujin / Threat-Actors-use-of-Artifical-Intelligence
  ☆158Updated last month
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆210Updated 3 months ago
• dhammon / ai-goat
  Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.
  ☆147Updated 3 weeks ago
• RiccardoBiosas / awesome-MLSecOps
  A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
  ☆220Updated last month
• subzer0girl2 / AI-Threat-Mind-Map
  ☆15Updated 4 months ago
• jthack / PIPE
  Prompt Injection Primer for Engineers
  ☆348Updated last year
• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆299Updated 7 months ago
• alexdevassy / Machine_Learning_CTF_Challenges
  CTF challenges designed and implemented in machine learning applications
  ☆99Updated 3 weeks ago
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆310Updated 3 months ago
• mitre-atlas / arsenal
  CALDERA plugin for adversary emulation of AI-enabled systems
  ☆82Updated last year
• DummyKitty / Cyber-Security-chatGPT-prompt
  some prompt about cyber security
  ☆137Updated last year
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆80Updated last week
• mik0w / pallms
  Payloads for Attacking Large Language Models
  ☆56Updated 2 months ago
• tenable / awesome-llm-cybersecurity-tools
  A curated list of large language model tools for cybersecurity research.
  ☆376Updated 5 months ago
• JosephTLucas / HackThisAI
  Adversarial Machine Learning (AML) Capture the Flag (CTF)
  ☆92Updated 6 months ago
• BishopFox / llm-testing-findings
  LLM Testing Findings Templates
  ☆65Updated 7 months ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆24Updated 3 months ago
• facebookresearch / privacy_adversarial_framework
  The Privacy Adversarial Framework (PAF) is a knowledge base of privacy-focused adversarial tactics and techniques. PAF is heavily inspire…
  ☆53Updated last year
• OWASP / www-project-top-10-for-large-language-model-applications
  OWASP Foundation Web Respository
  ☆504Updated last week
• forcesunseen / llm-hackers-handbook
  A guide to LLM hacking: fundamentals, prompt injection, offense, and defense
  ☆112Updated last year
• tenable / Burp-extension-for-GPT
  an extension for Burp Suite to allow researchers to utilize GPT for analys is of HTTP requests and responses
  ☆89Updated last year
• OWASP / owasp-istg
  The IoT Security Testing Guide (ISTG) provides a comprehensive methodology for penetration tests in the IoT field, offering flexibility t…
  ☆88Updated last month
• TakSec / Prompt-Injection-Everywhere
  Prompt Injections Everywhere
  ☆68Updated last month
• openai / openai-security-bots
  ☆344Updated 5 months ago