greshake / llm-securityLinks
New ways of breaking app-integrated LLMs
☆1,991Updated 2 months ago
Alternatives and similar repositories for llm-security
Users that are interested in llm-security are comparing it to the libraries listed below
Sorting:
- LLM Prompt Injection Detector☆1,348Updated last year
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆416Updated last year
- Universal and Transferable Attacks on Aligned Language Models☆4,209Updated last year
- OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)☆892Updated last week
- A curation of awesome tools, documents and projects about LLM Security.☆1,380Updated 3 weeks ago
- a security scanner for custom LLM applications☆959Updated 3 weeks ago
- The Security Toolkit for LLM Interactions☆2,043Updated last week
- Prompt Injection Primer for Engineers☆460Updated 2 years ago
- Every practical and proposed defense against prompt injection.☆546Updated 6 months ago
- Dropbox LLM Security research code and results☆235Updated last year
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆414Updated last year
- A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.☆623Updated last month
- ☆622Updated 2 months ago
- A language for constraint-guided and efficient LLM programming.☆4,051Updated 3 months ago
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆557Updated last month
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆315Updated last year
- A curated list of large language model tools for cybersecurity research.☆473Updated last year
- A curated list of useful resources that cover Offensive AI.☆1,280Updated last week
- Protection against Model Serialization Attacks☆566Updated last week
- LLMs for your CLI☆1,350Updated last year
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆945Updated 9 months ago
- Curation of prompts that are known to be adversarial to large language models☆185Updated 2 years ago
- Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!☆317Updated 11 months ago
- Adding guardrails to large language models.☆5,647Updated this week
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆527Updated 11 months ago
- A school for camelids☆1,209Updated 2 years ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆5,074Updated this week
- A benchmark for prompt injection detection systems.☆133Updated 2 weeks ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,932Updated last year
- Leverage hallucinations from Large Language Models (LLMs) for novelty-driven explorations.☆591Updated last year