StavC / Here-Comes-the-AI-WormLinks
Here Comes the AI Worm: Preventing the Propagation of Adversarial Self-Replicating Prompts Within GenAI Ecosystems
☆205Updated this week
Alternatives and similar repositories for Here-Comes-the-AI-Worm
Users that are interested in Here-Comes-the-AI-Worm are comparing it to the libraries listed below
Sorting:
- Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to pote…☆183Updated 5 months ago
- Tree of Attacks (TAP) Jailbreaking Implementation☆115Updated last year
- Lightweight LLM Interaction Framework☆371Updated this week
- Red-Teaming Language Models with DSPy☆211Updated 6 months ago
- A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)☆133Updated 8 months ago
- Code for the paper "Defeating Prompt Injections by Design"☆97Updated 2 months ago
- A utility to inspect, validate, sign and verify machine learning model files.☆58Updated 7 months ago
- Project Mantis: Hacking Back the AI-Hacker; Prompt Injection as a Defense Against LLM-driven Cyberattacks☆79Updated 3 months ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆114Updated last year
- Dropbox LLM Security research code and results☆233Updated last year
- HoneyAgents is a PoC demo of an AI-driven system that combines honeypots with autonomous AI agents to detect and mitigate cyber threats. …☆55Updated last year
- Manual Prompt Injection / Red Teaming Tool☆37Updated 11 months ago
- A YAML based format for describing tools to LLMs, like man pages but for robots!☆78Updated 4 months ago
- Codebase of https://arxiv.org/abs/2410.14923☆50Updated 10 months ago
- A toolkit for detecting and protecting against vulnerabilities in Large Language Models (LLMs).☆142Updated last year
- A Completely Modular LLM Reverse Engineering, Red Teaming, and Vulnerability Research Framework.☆50Updated 9 months ago
- ☆66Updated this week
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆410Updated last year
- Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models☆75Updated this week
- A benchmark for prompt injection detection systems.☆128Updated last week
- A knowledge source about TTPs used to target GenAI-based systems, copilots and agents☆118Updated last month
- Test Software for the Characterization of AI Technologies☆261Updated last week
- Payloads for Attacking Large Language Models☆98Updated 3 months ago
- ☆53Updated 3 weeks ago
- ☆145Updated 2 months ago
- https://arxiv.org/abs/2412.02776☆60Updated 9 months ago
- A collection of prompt injection mitigation techniques.☆24Updated 2 years ago
- ☆17Updated 8 months ago
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆96Updated 4 months ago
- The fastest Trust Layer for AI Agents☆142Updated 3 months ago