user1342 / Awesome-LLM-Red-TeamingLinks
A curated list of awesome LLM Red Teaming training, resources, and tools.
☆49Updated 2 months ago
Alternatives and similar repositories for Awesome-LLM-Red-Teaming
Users that are interested in Awesome-LLM-Red-Teaming are comparing it to the libraries listed below
Sorting:
- A guide to LLM hacking: fundamentals, prompt injection, offense, and defense☆174Updated 2 years ago
- An AI-powered application that conducts structured interviews to create and maintain detailed personal profiles across various life aspec…☆49Updated 7 months ago
- ☆58Updated 3 months ago
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆41Updated 8 months ago
- Cybersecurity Intelligent Pentesting Helper for Ethical Researcher (CIPHER). Fine tuned LLM for penetration testing guidance based on wri…☆33Updated 10 months ago
- Delving into the Realm of LLM Security: An Exploration of Offensive and Defensive Tools, Unveiling Their Present Capabilities.☆165Updated 2 years ago
- Penetration Testing AI Assistant based on open source LLMs.☆110Updated 7 months ago
- A collection of agents that use Large Language Models (LLMs) to perform tasks common on our day to day jobs in cyber security.☆207Updated last year
- Payloads for Attacking Large Language Models☆104Updated 5 months ago
- Project Mantis: Hacking Back the AI-Hacker; Prompt Injection as a Defense Against LLM-driven Cyberattacks☆88Updated 5 months ago
- Prompt Injections Everywhere☆162Updated last year
- Learn about a type of vulnerability that specifically targets machine learning models☆370Updated 2 months ago
- An AI-driven MCP server that autonomously interfaces with Malware Bazaar, delivering real-time threat intel and sample metadata for autho…☆21Updated 5 months ago
- LLM | Security | Operations in one github repo with good links and pictures.☆65Updated 10 months ago
- A Completely Modular LLM Reverse Engineering, Red Teaming, and Vulnerability Research Framework.☆52Updated last year
- A list of curated resources for people interested in AI Red Teaming, Jailbreaking, and Prompt Injection☆381Updated 6 months ago
- Powerful LLM Query Framework with YAML Prompt Templates. Made for Automation☆33Updated last month
- A LLM explicitly designed for getting hacked☆163Updated 2 years ago
- Manual Prompt Injection / Red Teaming Tool☆46Updated last year
- Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to pote…☆188Updated last month
- We present MAPTA, a multi-agent system for autonomous web application security assessment that combines large language model orchestratio…☆75Updated 2 months ago
- Lightweight LLM Interaction Framework☆392Updated this week
- A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)☆143Updated 10 months ago
- SourceGPT - prompt manager and source code analyzer built on top of ChatGPT as the oracle☆109Updated 2 years ago
- NOT for educational purposes: An MCP server for professional penetration testers including STDIO/HTTP/SSE support, nmap, go/dirbuster, ni…☆99Updated 4 months ago
- AI agent for autonomous cyber operations☆367Updated this week
- This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…☆53Updated last year
- Codebase of https://arxiv.org/abs/2410.14923☆52Updated last year
- Here Comes the AI Worm: Preventing the Propagation of Adversarial Self-Replicating Prompts Within GenAI Ecosystems☆218Updated 2 months ago
- A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.☆397Updated 3 months ago