Safetorun / PromptDefenderLinks
A prompt defence is a multi-layer defence that can be used to protect your applications against prompt injection attacks.
☆20Updated last year
Alternatives and similar repositories for PromptDefender
Users that are interested in PromptDefender are comparing it to the libraries listed below
Sorting:
- A collection of prompt injection mitigation techniques.☆25Updated 2 years ago
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆100Updated 8 months ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆44Updated 9 months ago
- Automated Safety Testing of Large Language Models☆17Updated 10 months ago
- ☆153Updated 3 months ago
- Code for the paper "Defeating Prompt Injections by Design"☆172Updated 5 months ago
- LLM security and privacy☆52Updated last year
- LLM | Security | Operations in one github repo with good links and pictures.☆69Updated this week
- ☆179Updated 6 months ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆33Updated last year
- The jailbreak-evaluation is an easy-to-use Python package for language model jailbreak evaluation.☆27Updated last year
- The fastest Trust Layer for AI Agents☆145Updated 6 months ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆78Updated 3 months ago
- Codebase of https://arxiv.org/abs/2410.14923☆52Updated last year
- Whispers in the Machine: Confidentiality in Agentic Systems☆41Updated this week
- Top 10 for Agentic AI (AI Agent Security) serves as the core for OWASP and CSA Red teaming work☆156Updated 2 months ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆100Updated 2 months ago
- LLM proxy to observe and debug what your AI agents are doing.☆57Updated last month
- A benchmark for prompt injection detection systems.☆151Updated 3 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆40Updated last month
- Payloads for Attacking Large Language Models☆112Updated 6 months ago
- Guardrails for secure and robust agent development☆369Updated 4 months ago
- Red-Teaming Language Models with DSPy☆244Updated 10 months ago
- ☆65Updated 3 months ago
- Code snippets to reproduce MCP tool poisoning attacks.☆187Updated 8 months ago
- Tools and our test data developed for the HackAPrompt 2023 competition☆45Updated 2 years ago
- Repo with random useful scripts, utilities, prompts and stuff☆189Updated 2 weeks ago
- ☆14Updated last year
- ☆55Updated 4 months ago