google-research / camel-prompt-injectionLinks
Code for the paper "Defeating Prompt Injections by Design"
☆172Updated 5 months ago
Alternatives and similar repositories for camel-prompt-injection
Users that are interested in camel-prompt-injection are comparing it to the libraries listed below
Sorting:
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- ☆178Updated 5 months ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆33Updated last year
- Code snippets to reproduce MCP tool poisoning attacks.☆187Updated 8 months ago
- Red-Teaming Language Models with DSPy☆244Updated 9 months ago
- Dropbox LLM Security research code and results☆248Updated last year
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆61Updated last week
- A benchmark for prompt injection detection systems.☆151Updated 3 months ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆77Updated 3 months ago
- Guardrails for secure and robust agent development☆369Updated 4 months ago
- A collection of prompt injection mitigation techniques.☆24Updated 2 years ago
- Codebase of https://arxiv.org/abs/2410.14923☆52Updated last year
- ☆151Updated 3 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆369Updated last week
- LLM proxy to observe and debug what your AI agents are doing.☆57Updated last month
- MCP security wrapper☆204Updated last week
- Lightweight LLM Interaction Framework☆396Updated this week
- Experimental tools to backdoor large language models by re-writing their system prompts at a raw parameter level. This allows you to pote…☆192Updated 2 months ago
- Here Comes the AI Worm: Preventing the Propagation of Adversarial Self-Replicating Prompts Within GenAI Ecosystems☆220Updated 3 months ago
- Project Mantis: Hacking Back the AI-Hacker; Prompt Injection as a Defense Against LLM-driven Cyberattacks☆92Updated 6 months ago
- ☆55Updated 7 months ago
- ☆65Updated 2 months ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆98Updated 2 months ago
- A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)☆150Updated 11 months ago
- Secure Jupyter Notebooks and Experimentation Environment☆84Updated 10 months ago
- Top 10 for Agentic AI (AI Agent Security) serves as the core for OWASP and CSA Red teaming work☆156Updated 2 months ago
- ☆70Updated last month
- ☆113Updated this week
- A YAML based format for describing tools to LLMs, like man pages but for robots!☆81Updated 7 months ago
- ☆93Updated 4 months ago