google-research / camel-prompt-injectionLinks
Code for the paper "Defeating Prompt Injections by Design"
☆187Updated 6 months ago
Alternatives and similar repositories for camel-prompt-injection
Users that are interested in camel-prompt-injection are comparing it to the libraries listed below
Sorting:
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- ☆182Updated 2 weeks ago
- A benchmark for prompt injection detection systems.☆153Updated 2 weeks ago
- A collection of prompt injection mitigation techniques.☆25Updated 2 years ago
- Codebase of https://arxiv.org/abs/2410.14923☆52Updated last year
- Risks and targets for assessing LLMs & LLM vulnerabilities☆33Updated last year
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆389Updated 3 weeks ago
- Dropbox LLM Security research code and results☆250Updated last year
- Code snippets to reproduce MCP tool poisoning attacks.☆188Updated 8 months ago
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆63Updated last week
- LLM proxy to observe and debug what your AI agents are doing.☆57Updated last month
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆78Updated 3 months ago
- ☆154Updated 3 months ago
- Red-Teaming Language Models with DSPy☆248Updated 10 months ago
- Supply chain security for ML☆213Updated last week
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆95Updated last year
- Implementation of BEAST adversarial attack for language models (ICML 2024)☆92Updated last year
- MCP security wrapper☆205Updated 3 weeks ago
- A utility to inspect, validate, sign and verify machine learning model files.☆62Updated 10 months ago
- Tree of Attacks (TAP) Jailbreaking Implementation☆116Updated last year
- General research for Dreadnode☆27Updated last year
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆101Updated 2 months ago
- The fastest Trust Layer for AI Agents☆144Updated 7 months ago
- Here Comes the AI Worm: Preventing the Propagation of Adversarial Self-Replicating Prompts Within GenAI Ecosystems☆222Updated 3 months ago
- ☆56Updated 5 months ago
- Do you want to learn AI Security but don't know where to start ? Take a look at this map.☆28Updated last year
- Guardrails for secure and robust agent development☆377Updated 5 months ago
- A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)☆152Updated last year
- ☆101Updated 5 months ago
- Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models☆91Updated last week