Papers and resources related to the security and privacy of LLMs π€
β568Jun 8, 2025Updated 8 months ago
Alternatives and similar repositories for llm-sp
Users that are interested in llm-sp are comparing it to the libraries listed below
Sorting:
- A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).β1,870Feb 23, 2026Updated last week
- A curation of awesome tools, documents and projects about LLM Security.β1,537Aug 20, 2025Updated 6 months ago
- This repository provides a benchmark for prompt injection attacks and defenses in LLMsβ396Oct 29, 2025Updated 4 months ago
- A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provideβ¦β1,783Feb 1, 2026Updated last month
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]β535Apr 4, 2025Updated 11 months ago
- LLM security and privacyβ53Oct 15, 2024Updated last year
- An easy-to-use Python framework to generate adversarial jailbreak prompts.β820Mar 27, 2025Updated 11 months ago
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Mβ¦β430Jan 22, 2025Updated last year
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)β163Nov 30, 2024Updated last year
- Universal and Transferable Attacks on Aligned Language Modelsβ4,534Aug 2, 2024Updated last year
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]β379Jan 23, 2025Updated last year
- β701Jul 2, 2025Updated 8 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Promptsβ568Feb 27, 2026Updated last week
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalβ864Aug 16, 2024Updated last year
- [S&P'24] Test-Time Poisoning Attacks Against Test-Time Adaptation Modelsβ19Feb 18, 2025Updated last year
- A lightweight library for large laguage model (LLM) jailbreaking defense.β61Sep 11, 2025Updated 5 months ago
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decodingβ151Jul 19, 2024Updated last year
- Repository for the Paper (AAAI 2024, Oral) --- Visual Adversarial Examples Jailbreak Large Language Modelsβ266May 13, 2024Updated last year
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.β188Apr 1, 2025Updated 11 months ago
- [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllabilityβ176Dec 18, 2024Updated last year
- [AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Promptsβ192Jun 26, 2025Updated 8 months ago
- We jailbreak GPT-3.5 Turboβs safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20β¦β341Feb 23, 2024Updated 2 years ago
- Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, dataβ¦β1,231Feb 6, 2026Updated last month
- π up-to-date & curated list of awesome Attacks on Large-Vision-Language-Models papers, methods & resources.β505Feb 17, 2026Updated 2 weeks ago
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".β69Oct 23, 2024Updated last year
- PAL: Proxy-Guided Black-Box Attack on Large Language Modelsβ57Aug 17, 2024Updated last year
- Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873β179May 6, 2024Updated last year
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacksβ18Apr 24, 2024Updated last year
- Code for ICLR 2025 Failures to Find Transferable Image Jailbreaks Between Vision-Language Modelsβ37Jun 1, 2025Updated 9 months ago
- New ways of breaking app-integrated LLMsβ2,055Jul 17, 2025Updated 7 months ago
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.β116Jun 13, 2024Updated last year
- β71Feb 16, 2025Updated last year
- A fast + lightweight implementation of the GCG algorithm in PyTorchβ319May 13, 2025Updated 9 months ago
- β58Jun 13, 2024Updated last year
- β20Feb 3, 2025Updated last year
- [CCS-LAMPS'24] LLM IP Protection Against Model Mergingβ16Oct 14, 2024Updated last year
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]β109Sep 27, 2024Updated last year
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)β65Jan 11, 2025Updated last year
- [ICML 2024] TrustLLM: Trustworthiness in Large Language Modelsβ618Jun 24, 2025Updated 8 months ago