greshake / llm-security
New ways of breaking app-integrated LLMs
☆1,829Updated last year
Related projects ⓘ
Alternatives and complementary repositories for llm-security
- LLM Prompt Injection Detector☆1,130Updated 3 months ago
- Universal and Transferable Attacks on Aligned Language Models☆3,459Updated 3 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆313Updated 8 months ago
- OWASP Foundation Web Respository☆578Updated this week
- the LLM vulnerability scanner☆2,612Updated this week
- A language for constraint-guided and efficient LLM programming.☆3,704Updated 5 months ago
- Adding guardrails to large language models.☆4,139Updated this week
- automatically tests prompt injection attacks on ChatGPT instances☆648Updated 11 months ago
- Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…☆3,272Updated 8 months ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆4,190Updated this week
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆1,972Updated 2 months ago
- The Security Toolkit for LLM Interactions☆1,249Updated last month
- A curation of awesome tools, documents and projects about LLM Security.☆955Updated this week
- Evaluation tool for LLM QA chains☆1,063Updated last year
- Prompt Injection Primer for Engineers☆362Updated last year
- ☆413Updated 3 months ago
- Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning …☆4,355Updated 3 weeks ago
- ☆1,022Updated last year
- ☆1,430Updated last year
- [NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning☆2,433Updated 11 months ago
- Build agents which are controlled by LLMs☆933Updated 8 months ago
- Visualization and debugging tool for LangChain workflows☆723Updated 8 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,714Updated 3 months ago
- ☆1,164Updated 6 months ago
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,470Updated 8 months ago
- A school for camelids☆1,208Updated last year
- Dropbox LLM Security research code and results☆217Updated 6 months ago
- Every practical and proposed defense against prompt injection.☆347Updated 5 months ago
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆851Updated 2 weeks ago
- ☆3,257Updated last year