user1342 / Awesome-LLM-Red-TeamingLinks
A curated list of awesome LLM Red Teaming training, resources, and tools.
☆22Updated 3 months ago
Alternatives and similar repositories for Awesome-LLM-Red-Teaming
Users that are interested in Awesome-LLM-Red-Teaming are comparing it to the libraries listed below
Sorting:
- Codebase of https://arxiv.org/abs/2410.14923☆48Updated 8 months ago
- Manual Prompt Injection / Red Teaming Tool☆32Updated 9 months ago
- An AI-powered application that conducts structured interviews to create and maintain detailed personal profiles across various life aspec…☆41Updated 3 months ago
- A Completely Modular LLM Reverse Engineering, Red Teaming, and Vulnerability Research Framework.☆46Updated 8 months ago
- A guide to LLM hacking: fundamentals, prompt injection, offense, and defense☆160Updated 2 years ago
- [SPOILER ALERT] Solutions to Gandalf, the prompt hacking/red teaming game from Lakera AI☆27Updated last year
- 🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.☆23Updated last year
- Prompt Engineering Tool for AI Models with cli prompt or api usage☆1Updated last year
- ☆22Updated this week
- 🤖 A GitHub action that leverages fabric patterns through an agent-based approach☆28Updated 6 months ago
- Project Mantis: Hacking Back the AI-Hacker; Prompt Injection as a Defense Against LLM-driven Cyberattacks☆71Updated last month
- This repository contains various attack against Large Language Models.☆111Updated last year
- Websites and tools for OSINT investigations pertaining to Israel☆23Updated 2 months ago
- SourceGPT - prompt manager and source code analyzer built on top of ChatGPT as the oracle☆111Updated 2 years ago
- A collection of prompt injection mitigation techniques.☆23Updated last year
- Payloads for Attacking Large Language Models☆92Updated last month
- The purpose of this document is to outline the security risks and vulnerabilities that may arise when implementing ChatGPT in web applica…☆30Updated 5 months ago
- Cybersecurity Intelligent Pentesting Helper for Ethical Researcher (CIPHER). Fine tuned LLM for penetration testing guidance based on wri…☆26Updated 6 months ago
- A list of curated resources for people interested in AI Red Teaming, Jailbreaking, and Prompt Injection☆238Updated 2 months ago
- [IJCAI 2024] Imperio is an LLM-powered backdoor attack. It allows the adversary to issue language-guided instructions to control the vict…☆42Updated 5 months ago
- Prompt Injections Everywhere☆134Updated 11 months ago
- ☆21Updated 9 months ago
- A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)☆122Updated 7 months ago
- The jailbreak-evaluation is an easy-to-use Python package for language model jailbreak evaluation.☆24Updated 8 months ago
- Stage 1: Sensitive Email/Chat Classification for Adversary Agent Emulation (espionage). This project is meant to extend Red Reaper v1 whi…☆42Updated 10 months ago
- A knowledge source about TTPs used to target GenAI-based systems, copilots and agents☆41Updated last month
- Learn about a type of vulnerability that specifically targets machine learning models☆310Updated last year
- ATLAS tactics, techniques, and case studies data☆77Updated 2 months ago
- Penetration Testing AI Assistant based on open source LLMs.☆90Updated 3 months ago
- ☆138Updated 2 months ago