xsankar / AI-Red-Teaming

Related projects ⓘ

Alternatives and complementary repositories for AI-Red-Teaming

• RiccardoBiosas / awesome-MLSecOps
  A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
  ☆246Updated last month
• mik0w / pallms
  Payloads for Attacking Large Language Models
  ☆64Updated 4 months ago
• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆16Updated 6 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆107Updated 8 months ago
• alexdevassy / Machine_Learning_CTF_Challenges
  CTF challenges designed and implemented in machine learning applications
  ☆114Updated 2 months ago
• subzer0girl2 / AI-Threat-Mind-Map
  ☆20Updated 2 months ago
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆217Updated 6 months ago
• Seezo-io / llm-security-101
  Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.
  ☆149Updated last year
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆95Updated 9 months ago
• NVISOsecurity / cyber-security-llm-agents
  A collection of agents that use Large Language Models (LLMs) to perform tasks common on our day to day jobs in cyber security.
  ☆56Updated 6 months ago
• ottosulin / awesome-ai-security
  A collection of awesome resources related AI security
  ☆131Updated 8 months ago
• dhammon / ai-goat
  Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.
  ☆248Updated 3 months ago
• harishsg993010 / DamnVulnerableLLMProject
  A LLM explicitly designed for getting hacked
  ☆130Updated last year
• moohax / Charcuterie
  Data Scientists Go To Jupyter
  ☆57Updated last week
• mitre-atlas / atlas-data
  ATLAS tactics, techniques, and case studies data
  ☆49Updated last month
• 5stars217 / offsecml
  source code for the offsecml framework
  ☆35Updated 5 months ago
• OWASP / www-project-machine-learning-security-top-10
  OWASP Machine Learning Security Top 10 Project
  ☆76Updated 2 months ago
• protectai / nbdefense
  Secure Jupyter Notebooks and Experimentation Environment
  ☆56Updated last month
• shlomihod / awesome-ai-red-teaming
  A curated list of awesome AI Red Teaming resources and tools.
  ☆11Updated last year
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆233Updated 9 months ago
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆87Updated 2 months ago
• TakSec / Prompt-Injection-Everywhere
  Prompt Injections Everywhere
  ☆85Updated 3 months ago
• NetsecExplained / Attacking-and-Defending-Generative-AI
  Reference notes for Attacking and Defending Generative AI presentation
  ☆37Updated 3 months ago
• WithSecureLabs / damn-vulnerable-llm-agent
  ☆181Updated 10 months ago
• Valhall-ai / prompt-injection-mitigations
  A collection of prompt injection mitigation techniques.
  ☆18Updated last year
• emmanueltsukerman / MLforRedTeamHackers
  Code repository for "Machine Learning For Red Team Hackers".
  ☆32Updated 4 years ago
• zmre / awesome-security-for-ai
  Awesome products for securing AI systems includes open source and commercial options and an infographic licensed CC-BY-SA-4.0.
  ☆48Updated 5 months ago
• mitre-atlas / arsenal
  CALDERA plugin for adversary emulation of AI-enabled systems
  ☆85Updated last year
• trailofbits / awesome-ml-security
  ☆94Updated last month
• morpheuslord / CVE-llm_dataset
  This is a dataset intended to train a LLM model for a completely CVE focused input and output.
  ☆44Updated last week