corca-ai / LLMFuzzAgentLinks
[Corca / ML] Automatically solved Gandalf AI with LLM
☆52Updated 2 years ago
Alternatives and similar repositories for LLMFuzzAgent
Users that are interested in LLMFuzzAgent are comparing it to the libraries listed below
Sorting:
- Curation of prompts that are known to be adversarial to large language models☆188Updated 2 years ago
- Dropbox LLM Security research code and results☆254Updated last year
- Red-Teaming Language Models with DSPy☆250Updated 11 months ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- Payloads for Attacking Large Language Models☆119Updated 3 weeks ago
- A guide to LLM hacking: fundamentals, prompt injection, offense, and defense☆182Updated 2 years ago
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆100Updated 9 months ago
- Prompt Injection Primer for Engineers☆549Updated 2 years ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆452Updated last year
- The fastest Trust Layer for AI Agents☆152Updated this week
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆618Updated 2 weeks ago
- A toolkit for detecting and protecting against vulnerabilities in Large Language Models (LLMs).☆152Updated this week
- A benchmark for prompt injection detection systems.☆158Updated last month
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.☆120Updated 2 years ago
- Security Threats related with MCP (Model Context Protocol), MCP Servers and more☆45Updated 9 months ago
- Here Comes the AI Worm: Preventing the Propagation of Adversarial Self-Replicating Prompts Within GenAI Ecosystems☆222Updated 5 months ago
- Risks and targets for assessing LLMs & LLM vulnerabilities☆33Updated last year
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆200Updated 9 months ago
- HoneyAgents is a PoC demo of an AI-driven system that combines honeypots with autonomous AI agents to detect and mitigate cyber threats. …☆59Updated 2 years ago
- A library for red-teaming LLM applications with LLMs.☆29Updated last year
- Uses the ChatGPT model to determine if a user-supplied question is safe and filter out dangerous questions☆49Updated 2 years ago
- ☆26Updated last year
- ☆190Updated last month
- This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…☆56Updated 2 years ago
- source for llmsec.net☆16Updated last year
- Code for the paper "Defeating Prompt Injections by Design"☆232Updated 7 months ago
- Framework for LLM evaluation, guardrails and security☆114Updated last year
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆50Updated 11 months ago
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆452Updated 2 years ago