greshake / llm-securityLinks
New ways of breaking app-integrated LLMs
☆1,976Updated last month
Alternatives and similar repositories for llm-security
Users that are interested in llm-security are comparing it to the libraries listed below
Sorting:
- LLM Prompt Injection Detector☆1,331Updated last year
- Universal and Transferable Attacks on Aligned Language Models☆4,151Updated last year
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆406Updated last year
- The Security Toolkit for LLM Interactions☆1,982Updated last week
- OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)☆863Updated 2 weeks ago
- Every practical and proposed defense against prompt injection.☆528Updated 6 months ago
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆938Updated 9 months ago
- Dropbox LLM Security research code and results☆233Updated last year
- Adding guardrails to large language models.☆5,489Updated last month
- A curated list of useful resources that cover Offensive AI.☆1,269Updated last week
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆409Updated last year
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆5,004Updated this week
- A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.☆621Updated 2 weeks ago
- An open-source visual programming environment for battle-testing prompts to LLMs.☆2,728Updated last week
- A language for constraint-guided and efficient LLM programming.☆4,037Updated 3 months ago
- Evaluation tool for LLM QA chains☆1,086Updated 2 years ago
- ☆1,485Updated 2 years ago
- ☆599Updated last month
- A curation of awesome tools, documents and projects about LLM Security.☆1,351Updated this week
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆307Updated last year
- A school for camelids☆1,209Updated 2 years ago
- Agent techniques to augment your LLM and push it beyong its limits☆1,583Updated last year
- Protection against Model Serialization Attacks☆547Updated 2 weeks ago
- Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!☆314Updated 10 months ago
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆2,136Updated 6 months ago
- Minimal Python library to connect to LLMs (OpenAI, Anthropic, Google, Groq, Reka, Together, AI21, Cohere, Aleph Alpha, HuggingfaceHub), w…☆791Updated 2 weeks ago
- A Bulletproof Way to Generate Structured JSON from Language Models☆4,799Updated last year
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆519Updated 11 months ago
- Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chro…☆2,927Updated last year
- Simple UI for LLM Model Finetuning☆2,064Updated last year