corca-ai / awesome-llm-security
A curation of awesome tools, documents and projects about LLM Security.
☆1,070Updated this week
Alternatives and similar repositories for awesome-llm-security:
Users that are interested in awesome-llm-security are comparing it to the libraries listed below
- A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).☆1,171Updated this week
- Papers and resources related to the security and privacy of LLMs 🤖☆478Updated 2 months ago
- ☆497Updated 2 months ago
- A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide…☆1,177Updated 2 weeks ago
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆541Updated 6 months ago
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…☆292Updated last month
- Awesome LLM Jailbreak academic papers☆90Updated last year
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆297Updated 4 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆450Updated 4 months ago
- Every practical and proposed defense against prompt injection.☆388Updated 8 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆333Updated 11 months ago
- Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, data…☆475Updated 2 weeks ago
- This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses☆172Updated last month
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆553Updated 5 months ago
- Papers about red teaming LLMs and Multimodal models.☆96Updated 3 months ago
- The automated prompt injection framework for LLM-integrated applications.☆185Updated 5 months ago
- LLM security and privacy☆47Updated 4 months ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆276Updated 11 months ago
- [ICML 2024] TrustLLM: Trustworthiness in Large Language Models☆516Updated this week
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆258Updated last year
- TAP: An automated jailbreaking method for black-box LLMs☆145Updated 2 months ago
- ⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs☆350Updated last year
- List of papers on hallucination detection in LLMs.☆773Updated 2 months ago
- [NDSS'25 Poster] A collection of automated evaluators for assessing jailbreak attempts.☆110Updated this week
- [USENIX Security 2025] PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models☆117Updated 2 weeks ago
- 😎 up-to-date & curated list of awesome Attacks on Large-Vision-Language-Models papers, methods & resources.☆213Updated this week
- A resource repository for machine unlearning in large language models☆311Updated 2 weeks ago
- [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey☆87Updated 6 months ago
- Learn about a type of vulnerability that specifically targets machine learning models☆220Updated 8 months ago
- Accepted by IJCAI-24 Survey Track☆190Updated 5 months ago