corca-ai / LLMFuzzAgentLinks
[Corca / ML] Automatically solved Gandalf AI with LLM
☆52Updated 2 years ago
Alternatives and similar repositories for LLMFuzzAgent
Users that are interested in LLMFuzzAgent are comparing it to the libraries listed below
Sorting:
- Dropbox LLM Security research code and results☆245Updated last year
- Curation of prompts that are known to be adversarial to large language models☆186Updated 2 years ago
- Payloads for Attacking Large Language Models☆106Updated 5 months ago
- Red-Teaming Language Models with DSPy☆238Updated 9 months ago
- The fastest Trust Layer for AI Agents☆145Updated 6 months ago
- A guide to LLM hacking: fundamentals, prompt injection, offense, and defense☆176Updated 2 years ago
- A toolkit for detecting and protecting against vulnerabilities in Large Language Models (LLMs).☆151Updated last year
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆591Updated 2 months ago
- A subset of jailbreaks automatically discovered by the Haize Labs haizing suite.☆99Updated 7 months ago
- source for llmsec.net☆16Updated last year
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆430Updated last year
- Fiddler Auditor is a tool to evaluate language models.☆188Updated last year
- A benchmark for prompt injection detection systems.☆150Updated 3 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆437Updated last year
- Prompt Injection Primer for Engineers☆503Updated 2 years ago
- AgentFence is an open-source platform for automatically testing AI agent security. It identifies vulnerabilities such as prompt injection…☆42Updated 8 months ago
- Here Comes the AI Worm: Preventing the Propagation of Adversarial Self-Replicating Prompts Within GenAI Ecosystems☆218Updated 2 months ago
- A library for red-teaming LLM applications with LLMs.☆28Updated last year
- Security Threats related with MCP (Model Context Protocol), MCP Servers and more☆39Updated 7 months ago
- Framework for LLM evaluation, guardrails and security☆113Updated last year
- This project investigates the security of large language models by performing binary classification of a set of input prompts to discover…☆53Updated last year
- ☆173Updated 5 months ago
- 📚 A curated list of papers & technical articles on AI Quality & Safety☆193Updated 7 months ago
- Approximation of the Claude 3 tokenizer by inspecting generation stream☆147Updated last year
- Code for the paper "Defeating Prompt Injections by Design"☆151Updated 5 months ago
- Every practical and proposed defense against prompt injection.☆586Updated 9 months ago
- Masked Python SDK wrapper for OpenAI API. Use public LLM APIs securely.☆119Updated 2 years ago
- This shows the results from using a second, filter LLM that analyses prompts before sending them to GPT-Chat☆113Updated 2 years ago
- LLM Prompt Injection Detector☆1,381Updated last year
- Making LLMs generate entire projects. Go from idea to runnable project in one step.☆34Updated 2 years ago