corca-ai / LLMFuzzAgentLinks
[Corca / ML] Automatically solved Gandalf AI with LLM
☆51Updated 2 years ago
Alternatives and similar repositories for LLMFuzzAgent
Users that are interested in LLMFuzzAgent are comparing it to the libraries listed below
Sorting:
- Curation of prompts that are known to be adversarial to large language models☆184Updated 2 years ago
- Dropbox LLM Security research code and results☆241Updated last year
- Red-Teaming Language Models with DSPy☆235Updated 8 months ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- Payloads for Attacking Large Language Models☆104Updated 5 months ago
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆98Updated 6 months ago
- A toolkit for detecting and protecting against vulnerabilities in Large Language Models (LLMs).☆151Updated last year
- A guide to LLM hacking: fundamentals, prompt injection, offense, and defense☆173Updated 2 years ago
- Turning Gandalf against itself. Use LLMs to automate playing Lakera Gandalf challenge without needing to set up an account with a platfor…☆28Updated 2 years ago
- A benchmark for prompt injection detection systems.☆144Updated 2 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆433Updated last year
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆581Updated last month
- Prompt Injection Primer for Engineers☆494Updated 2 years ago
- The fastest Trust Layer for AI Agents☆144Updated 5 months ago
- Security Threats related with MCP (Model Context Protocol), MCP Servers and more☆38Updated 6 months ago
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆27Updated 8 months ago
- source for llmsec.net☆16Updated last year
- Here Comes the AI Worm: Preventing the Propagation of Adversarial Self-Replicating Prompts Within GenAI Ecosystems☆217Updated 2 months ago
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆193Updated 6 months ago
- Lightweight LLM Interaction Framework☆390Updated last week
- Code for the paper "Defeating Prompt Injections by Design"☆143Updated 4 months ago
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆423Updated last year
- Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.☆119Updated 2 years ago
- Framework for LLM evaluation, guardrails and security☆113Updated last year
- This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…☆52Updated last year
- ☆35Updated 5 months ago
- This shows the results from using a second, filter LLM that analyses prompts before sending them to GPT-Chat☆113Updated 2 years ago
- LLM Prompt Injection Detector☆1,364Updated last year
- A tool for evaluating LLMs☆425Updated last year