greshake / llm-security
New ways of breaking app-integrated LLMs
☆1,877Updated last year
Alternatives and similar repositories for llm-security:
Users that are interested in llm-security are comparing it to the libraries listed below
- LLM Prompt Injection Detector☆1,166Updated 5 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆326Updated 11 months ago
- The Security Toolkit for LLM Interactions☆1,373Updated 2 weeks ago
- Universal and Transferable Attacks on Aligned Language Models☆3,599Updated 5 months ago
- A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.☆569Updated 2 weeks ago
- OWASP Foundation Web Respository☆631Updated this week
- A curation of awesome tools, documents and projects about LLM Security.☆1,037Updated 2 weeks ago
- ☆470Updated last month
- Every practical and proposed defense against prompt injection.☆382Updated 7 months ago
- Prompt Injection Primer for Engineers☆404Updated last year
- ☆1,447Updated last year
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆438Updated 4 months ago
- A language for constraint-guided and efficient LLM programming.☆3,787Updated 7 months ago
- Adding guardrails to large language models.☆4,410Updated last week
- A curated list of useful resources that cover Offensive AI.☆1,153Updated 3 weeks ago
- Simple UI for LLM Model Finetuning☆2,049Updated last year
- An LLM-based autonomous agent controlling real-world applications via RESTful APIs☆1,343Updated 7 months ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,674Updated last year
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆341Updated 11 months ago
- a prompt injection scanner for custom LLM applications☆715Updated last week
- A school for camelids☆1,211Updated last year
- Evaluation tool for LLM QA chains☆1,067Updated last year
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,554Updated 11 months ago
- Dropbox LLM Security research code and results☆219Updated 8 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,773Updated 5 months ago
- Alpaca dataset from Stanford, cleaned and curated☆1,532Updated last year
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆4,365Updated this week
- Minimal Python library to connect to LLMs (OpenAI, Anthropic, Google, Groq, Reka, Together, AI21, Cohere, Aleph Alpha, HuggingfaceHub), w…☆738Updated this week
- A unified evaluation framework for large language models☆2,518Updated 3 months ago
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆870Updated 2 months ago