Alternatives and similar repositories for AI-Red-Teaming:

Users that are interested in AI-Red-Teaming are comparing it to the libraries listed below

• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆22Updated 9 months ago
• NYU-LLM-CTF / nyuctf_agents
  The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench
  ☆49Updated 2 weeks ago
• mik0w / pallms
  Payloads for Attacking Large Language Models
  ☆74Updated 7 months ago
• LLMSecurity / HouYi
  The automated prompt injection framework for LLM-integrated applications.
  ☆185Updated 5 months ago
• ottosulin / awesome-ai-security
  A collection of awesome resources related AI security
  ☆174Updated 2 weeks ago
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆258Updated last year
• BishopFox / BrokenHill
  A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)
  ☆84Updated 2 months ago
• alexdevassy / Machine_Learning_CTF_Challenges
  CTF challenges designed and implemented in machine learning applications
  ☆131Updated 5 months ago
• ShenaoW / awesome-llm-supply-chain-security
  A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)
  ☆38Updated last month
• Valhall-ai / prompt-injection-mitigations
  A collection of prompt injection mitigation techniques.
  ☆20Updated last year
• 5stars217 / malicious_models
  using ML models for red teaming
  ☆42Updated last year
• NVISOsecurity / cyber-security-llm-agents
  A collection of agents that use Large Language Models (LLMs) to perform tasks common on our day to day jobs in cyber security.
  ☆85Updated 9 months ago
• datasec-lab / CodeBreaker
  [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…
  ☆36Updated 3 months ago
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆99Updated last year
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆96Updated 2 weeks ago
• harishsg993010 / DamnVulnerableLLMProject
  A LLM explicitly designed for getting hacked
  ☆136Updated last year
• moohax / Charcuterie
  Data Scientists Go To Jupyter
  ☆62Updated 2 months ago
• liu00222 / Open-Prompt-Injection
  This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
  ☆172Updated 3 weeks ago
• humane-intelligence / ai_village_defcon_grt_data
  ☆13Updated 8 months ago
• dreadnode / research
  General research for Dreadnode
  ☆19Updated 8 months ago
• HKU-TASR / Imperio
  [IJCAI 2024] Imperio is an LLM-powered backdoor attack. It allows the adversary to issue language-guided instructions to control the vict…
  ☆41Updated this week
• NickNameInvalid / LLM_CTF
  ☆64Updated last month
• NYU-LLM-CTF / NYU_CTF_Bench
  ☆34Updated 2 weeks ago
• NASP-THU / ProphetFuzz
  [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.
  ☆64Updated last month
• wearetyomsmnv / Awesome-LLMSecOps
  LLM | Security | Operations in one github repo with good links and pictures.
  ☆24Updated last month
• xbow-engineering / validation-benchmarks
  XBOW Validation Benchmarks
  ☆71Updated 5 months ago
• NUS-Curiosity / VulZoo
  VulZoo: A Comprehensive Vulnerability Intelligence Dataset (ASE 2024 Demo)
  ☆30Updated 3 months ago
• 5stars217 / offsecml
  source code for the offsecml framework
  ☆37Updated 8 months ago
• trailofbits / awesome-ml-security
  ☆118Updated 3 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆108Updated 11 months ago