zmre / awesome-security-for-aiLinks
Awesome products for securing AI systems includes open source and commercial options and an infographic licensed CC-BY-SA-4.0.
☆64Updated last year
Alternatives and similar repositories for awesome-security-for-ai
Users that are interested in awesome-security-for-ai are comparing it to the libraries listed below
Sorting:
- source code for the offsecml framework☆41Updated last year
- Reference notes for Attacking and Defending Generative AI presentation☆64Updated 11 months ago
- Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.☆163Updated last year
- Payloads for Attacking Large Language Models☆91Updated last month
- ☆254Updated 6 months ago
- ☆40Updated last week
- Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models☆61Updated this week
- A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)☆122Updated 6 months ago
- NOVA: The Prompt Pattern Matching☆128Updated 2 months ago
- Application which investigates defensive measures against prompt injection attacks on an LLM, with a focus on the exposure of external to…☆31Updated 8 months ago
- A Caldera plugin for the emulation of complete, realistic cyberattack chains.☆54Updated 4 months ago
- A LLM explicitly designed for getting hacked☆153Updated last year
- LLM Testing Findings Templates☆72Updated last year
- A knowledge source about TTPs used to target GenAI-based systems, copilots and agents☆41Updated 3 weeks ago
- CALDERA plugin for adversary emulation of AI-enabled systems☆100Updated last year
- All things specific to LLM Red Teaming Generative AI☆27Updated 8 months ago
- ☆41Updated 7 months ago
- A YAML based format for describing tools to LLMs, like man pages but for robots!☆75Updated 2 months ago
- An interactive CLI application for interacting with authenticated Jupyter instances.☆53Updated 2 months ago
- Dropbox LLM Security research code and results☆228Updated last year
- Payloads for AI Red Teaming and beyond☆115Updated this week
- Top 10 for Agentic AI (AI Agent Security) serves as the core for OWASP and CSA Red teaming work☆119Updated last month
- Cybersecurity Intelligent Pentesting Helper for Ethical Researcher (CIPHER). Fine tuned LLM for penetration testing guidance based on wri…☆25Updated 6 months ago
- Data Scientists Go To Jupyter☆63Updated 4 months ago
- ☆274Updated 2 weeks ago
- AIGoat: A deliberately Vulnerable AI Infrastructure. Learn AI security through solving our challenges.☆237Updated 2 months ago
- A powerful tool that leverages AI to automatically generate comprehensive security documentation for your projects☆89Updated 2 months ago
- ☆54Updated last week
- An example vulnerable app that integrates an LLM☆22Updated last year
- Collection of Docker honeypot logs from 2021 - 2024☆36Updated 9 months ago