greshake / llm-security
New ways of breaking app-integrated LLMs
☆1,909Updated last year
Alternatives and similar repositories for llm-security:
Users that are interested in llm-security are comparing it to the libraries listed below
- LLM Prompt Injection Detector☆1,224Updated 7 months ago
- The Security Toolkit for LLM Interactions☆1,550Updated last week
- Universal and Transferable Attacks on Aligned Language Models☆3,817Updated 8 months ago
- OWASP Foundation Web Respository☆693Updated this week
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆352Updated last year
- A language for constraint-guided and efficient LLM programming.☆3,873Updated 10 months ago
- A curation of awesome tools, documents and projects about LLM Security.☆1,150Updated last week
- a prompt injection scanner for custom LLM applications☆761Updated 3 weeks ago
- Every practical and proposed defense against prompt injection.☆413Updated last month
- A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.☆583Updated 2 months ago
- ☆533Updated 4 months ago
- Minimal Python library to connect to LLMs (OpenAI, Anthropic, Google, Groq, Reka, Together, AI21, Cohere, Aleph Alpha, HuggingfaceHub), w…☆759Updated last week
- Prompt Injection Primer for Engineers☆423Updated last year
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆369Updated last year
- Adding guardrails to large language models.☆4,713Updated this week
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,667Updated last year
- ☆1,465Updated last year
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆4,591Updated this week
- the LLM vulnerability scanner☆4,198Updated last week
- Agent techniques to augment your LLM and push it beyong its limits☆1,570Updated 10 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆471Updated 6 months ago
- Dropbox LLM Security research code and results☆221Updated 10 months ago
- Evaluation tool for LLM QA chains☆1,073Updated last year
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆3,455Updated last month
- A school for camelids☆1,208Updated last year
- Inspect: A framework for large language model evaluations☆858Updated this week
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆895Updated 4 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,825Updated 7 months ago
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆2,079Updated last month
- A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain☆3,474Updated last year