greshake / llm-securityLinks
New ways of breaking app-integrated LLMs
☆2,007Updated 4 months ago
Alternatives and similar repositories for llm-security
Users that are interested in llm-security are comparing it to the libraries listed below
Sorting:
- LLM Prompt Injection Detector☆1,375Updated last year
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆435Updated last year
- OWASP Top 10 for Large Language Model Apps (Part of the GenAI Security Project)☆952Updated this week
- Every practical and proposed defense against prompt injection.☆579Updated 9 months ago
- Universal and Transferable Attacks on Aligned Language Models☆4,328Updated last year
- A curation of awesome tools, documents and projects about LLM Security.☆1,450Updated 3 months ago
- A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.☆632Updated 3 months ago
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆430Updated last year
- Dropbox LLM Security research code and results☆243Updated last year
- The Security Toolkit for LLM Interactions☆2,261Updated 2 weeks ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆327Updated last year
- ☆648Updated 4 months ago
- Prompt Injection Primer for Engineers☆499Updated 2 years ago
- A curated list of useful resources that cover Offensive AI.☆1,297Updated last week
- a security scanner for custom LLM applications☆1,031Updated last month
- Protection against Model Serialization Attacks☆601Updated last month
- Make your GenAI Apps Safe & Secure Test & harden your system prompt☆587Updated last month
- Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!☆333Updated last month
- ☆1,495Updated 2 years ago
- Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.☆2,148Updated 9 months ago
- CodeTF: One-stop Transformer Library for State-of-the-art Code LLM☆1,478Updated 6 months ago
- NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.☆5,280Updated this week
- A language for constraint-guided and efficient LLM programming.☆4,081Updated 6 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆542Updated last year
- Adding guardrails to large language models.☆5,970Updated 2 weeks ago
- A library for helping developers craft prompts for Large Language Models☆2,723Updated 2 years ago
- The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and eng…☆3,123Updated this week
- 🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring sa…☆959Updated 11 months ago
- Curation of prompts that are known to be adversarial to large language models☆186Updated 2 years ago
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆782Updated last year