shlomihod / awesome-ai-red-teaming

Related projects ⓘ

Alternatives and complementary repositories for awesome-ai-red-teaming

• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆231Updated 9 months ago
• xsankar / AI-Red-Teaming
  All things specific to LLM Red Teaming Generative AI
  ☆14Updated 3 weeks ago
• dropbox / llm-security
  Dropbox LLM Security research code and results
  ☆216Updated 5 months ago
• RiccardoBiosas / awesome-MLSecOps
  A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
  ☆240Updated last month
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆95Updated 9 months ago
• NickNameInvalid / LLM_CTF
  ☆61Updated last month
• deadbits / vigil-llm
  ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
  ☆309Updated 9 months ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆40Updated 3 weeks ago
• timothee-chauvin / eyeballvul
  future-proof vulnerability detection benchmark, based on CVEs in open-source repos
  ☆44Updated this week
• NYU-LLM-CTF / NYU_CTF_Bench
  ☆21Updated last month
• tldrsec / prompt-injection-defenses
  Every practical and proposed defense against prompt injection.
  ☆339Updated 5 months ago
• WithSecureLabs / damn-vulnerable-llm-agent
  ☆178Updated 10 months ago
• liu00222 / Open-Prompt-Injection
  This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
  ☆142Updated 2 months ago
• LLMSecurity / HouYi
  The automated prompt injection framework for LLM-integrated applications.
  ☆161Updated 2 months ago
• andyzorigin / cybench
  ☆57Updated 2 weeks ago
• xbow-engineering / validation-benchmarks
  XBOW Validation Benchmarks
  ☆52Updated 2 months ago
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆107Updated 8 months ago
• alexdevassy / Machine_Learning_CTF_Challenges
  CTF challenges designed and implemented in machine learning applications
  ☆111Updated 2 months ago
• Seezo-io / llm-security-101
  Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.
  ☆149Updated last year
• dhammon / ai-goat
  Learn AI security through a series of vulnerable LLM CTF challenges. No sign ups, no cloud fees, run everything locally on your system.
  ☆247Updated 2 months ago
• trailofbits / awesome-ml-security
  ☆93Updated last month
• lakeraai / pint-benchmark
  A benchmark for prompt injection detection systems.
  ☆86Updated 2 months ago
• uiuc-kang-lab / InjecAgent
  ☆38Updated 4 months ago
• tmylla / Awesome-LLM4Cybersecurity
  An overview of LLMs for cybersecurity.
  ☆412Updated last month
• morpheuslord / CVE-llm_dataset
  This is a dataset intended to train a LLM model for a completely CVE focused input and output.
  ☆44Updated this week
• yyzpiero / RL4RedTeam
  A PPO agent leveraging reinforcement learning performs Penetration Testing in a simulated computer network environment. The agent is trai…
  ☆21Updated last year
• JosephTLucas / HackThisAI
  Adversarial Machine Learning (AML) Capture the Flag (CTF)
  ☆94Updated 8 months ago
• sinanw / llm-security-prompt-injection
  This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…
  ☆34Updated 10 months ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆25Updated 5 months ago
• ottosulin / awesome-ai-security
  A collection of awesome resources related AI security
  ☆124Updated 7 months ago