xsankar / AI-Red-Teaming

Related projects ⓘ

Alternatives and complementary repositories for AI-Red-Teaming

• mik0w / pallms
  Payloads for Attacking Large Language Models
  ☆63Updated 4 months ago
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆231Updated 9 months ago
• RiccardoBiosas / awesome-MLSecOps
  A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
  ☆240Updated last month
• 5stars217 / offsecml
  source code for the offsecml framework
  ☆35Updated 5 months ago
• alexdevassy / Machine_Learning_CTF_Challenges
  CTF challenges designed and implemented in machine learning applications
  ☆111Updated 2 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆107Updated 8 months ago
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆216Updated 5 months ago
• NVISOsecurity / cyber-security-llm-agents
  A collection of agents that use Large Language Models (LLMs) to perform tasks common on our day to day jobs in cyber security.
  ☆56Updated 6 months ago
• moohax / Charcuterie
  Data Scientists Go To Jupyter
  ☆57Updated 2 years ago
• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆15Updated 5 months ago
• zmre / awesome-security-for-ai
  Awesome products for securing AI systems includes open source and commercial options and an infographic licensed CC-BY-SA-4.0.
  ☆48Updated 5 months ago
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆95Updated 9 months ago
• harishsg993010 / DamnVulnerableLLMProject
  A LLM explicitly designed for getting hacked
  ☆129Updated last year
• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆309Updated 9 months ago
• TakSec / Prompt-Injection-Everywhere
  Prompt Injections Everywhere
  ☆84Updated 3 months ago
• subzer0girl2 / AI-Threat-Mind-Map
  ☆20Updated last month
• 5stars217 / malicious_models
  using ML models for red teaming
  ☆39Updated last year
• BishopFox / BrokenHill
  A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)
  ☆38Updated this week
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆86Updated 2 months ago
• Seezo-io / llm-security-101
  Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.
  ☆149Updated last year
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆339Updated 5 months ago
• mitre-atlas / arsenal
  CALDERA plugin for adversary emulation of AI-enabled systems
  ☆85Updated last year
• ottosulin / awesome-ai-security
  A collection of awesome resources related AI security
  ☆124Updated 7 months ago
• dhammon / ai-goat
  Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.
  ☆247Updated 2 months ago
• morpheuslord / CVE-llm_dataset
  This is a dataset intended to train a LLM model for a completely CVE focused input and output.
  ☆44Updated this week
• timothee-chauvin / eyeballvul
  future-proof vulnerability detection benchmark, based on CVEs in open-source repos
  ☆44Updated this week
• humane-intelligence / ai_village_defcon_grt_data
  ☆13Updated 5 months ago
• shlomihod / awesome-ai-red-teaming
  A curated list of awesome AI Red Teaming resources and tools.
  ☆10Updated last year
• moohax / Talks
  Central repo for talks and presentations
  ☆43Updated 3 months ago
• Valhall-ai / prompt-injection-mitigations
  A collection of prompt injection mitigation techniques.
  ☆17Updated last year