Alternatives and similar repositories for AI-Red-Teaming

Users that are interested in AI-Red-Teaming are comparing it to the libraries listed below

• BishopFox / BrokenHill
  A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)
  ☆134Updated 9 months ago
• dreadnode / AIRTBench-Code
  Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models
  ☆77Updated this week
• mik0w / pallms
  Payloads for Attacking Large Language Models
  ☆99Updated 3 months ago
• NetsecExplained / Attacking-and-Defending-Generative-AI
  Reference notes for Attacking and Defending Generative AI presentation
  ☆65Updated last year
• ReversecLabs / spikee
  ☆68Updated this week
• Seezo-io / llm-security-101
  Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.
  ☆164Updated last year
• 5stars217 / malicious_models
  using ML models for red teaming
  ☆44Updated 2 years ago
• 5stars217 / offsecml
  source code for the offsecml framework
  ☆41Updated last year
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆115Updated last year
• OzorioSec / FAAST
  Prototype of Full Agentic Application Security Testing, FAAST = SAST + DAST + LLM agents
  ☆63Updated 4 months ago
• pasquini-dario / LLMmap
  ☆64Updated last month
• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆25Updated last year
• zmre / awesome-security-for-ai
  Awesome products for securing AI systems includes open source and commercial options and an infographic licensed CC-BY-SA-4.0.
  ☆70Updated last year
• NetSPI / Open-LLM-Security-Benchmark
  ☆19Updated 9 months ago
• wearetyomsmnv / Awesome-LLMSecOps
  LLM | Security | Operations in one github repo with good links and pictures.
  ☆55Updated 8 months ago
• invariantlabs-ai / mcp-injection-experiments
  Code snippets to reproduce MCP tool poisoning attacks.
  ☆181Updated 5 months ago
• alexdevassy / Machine_Learning_CTF_Challenges
  CTF challenges designed and implemented in machine learning applications
  ☆166Updated last year
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆136Updated 3 weeks ago
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆235Updated last year
• arthurgervais / mapta
  We present MAPTA, a multi-agent system for autonomous web application security assessment that combines large language model orchestratio…
  ☆58Updated 3 weeks ago
• PalisadeResearch / intercode
  https://arxiv.org/abs/2412.02776
  ☆62Updated 9 months ago
• HKU-TASR / Imperio
  [IJCAI 2024] Imperio is an LLM-powered backdoor attack. It allows the adversary to issue language-guided instructions to control the vict…
  ☆41Updated 7 months ago
• bsinger98 / Incalmo
  ☆54Updated this week
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆315Updated last year
• TalEliyahu / Awesome-AI-Security
  Curated resources, research, and tools for securing AI systems
  ☆80Updated last week
• NVISOsecurity / cyber-security-llm-agents
  A collection of agents that use Large Language Models (LLMs) to perform tasks common on our day to day jobs in cyber security.
  ☆171Updated last year
• harishsg993010 / DamnVulnerableLLMProject
  A LLM explicitly designed for getting hacked
  ☆160Updated 2 years ago
• mitre-atlas / arsenal
  CALDERA plugin for adversary emulation of AI-enabled systems
  ☆99Updated 2 years ago
• ReversecLabs / llm-vulnerable-recruitment-app
  An example vulnerable app that integrates an LLM
  ☆24Updated last year
• dhammon / ai-goat
  Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.
  ☆299Updated last year