corca-ai / awesome-llm-security
A curation of awesome tools, documents and projects about LLM Security.
☆1,186Updated last week
Alternatives and similar repositories for awesome-llm-security:
Users that are interested in awesome-llm-security are comparing it to the libraries listed below
- Papers and resources related to the security and privacy of LLMs 🤖☆496Updated 4 months ago
- A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).☆1,362Updated last week
- ☆540Updated 4 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆477Updated 7 months ago
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆332Updated 3 weeks ago
- This repository provides a benchmark for prompt Injection attacks and defenses☆188Updated last week
- A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide…☆1,336Updated last week
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…☆319Updated 3 months ago
- Every practical and proposed defense against prompt injection.☆424Updated 2 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆361Updated last year
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆627Updated 8 months ago
- TAP: An automated jailbreaking method for black-box LLMs☆165Updated 4 months ago
- Papers about red teaming LLMs and Multimodal models.☆109Updated 5 months ago
- Awesome LLM Jailbreak academic papers☆93Updated last year
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆378Updated last year
- LLM security and privacy☆48Updated 6 months ago
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆629Updated 3 weeks ago
- Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, data…☆626Updated this week
- Learn about a type of vulnerability that specifically targets machine learning models☆258Updated 10 months ago
- The automated prompt injection framework for LLM-integrated applications.☆198Updated 7 months ago
- A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.☆313Updated 4 months ago
- A curated list of awesome security tools, experimental case or other interesting things with LLM or GPT.☆588Updated 3 months ago
- OWASP Foundation Web Respository☆700Updated last week
- 😎 up-to-date & curated list of awesome Attacks on Large-Vision-Language-Models papers, methods & resources.☆271Updated 2 weeks ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆274Updated last year
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆240Updated 10 months ago
- Accepted by IJCAI-24 Survey Track☆200Updated 8 months ago
- [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey☆94Updated 8 months ago
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆294Updated 3 months ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆290Updated last year