Papers and resources related to the security and privacy of LLMs 🤖
☆583Jun 8, 2025Updated last year
Alternatives and similar repositories for llm-sp
Users that are interested in llm-sp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).☆2,082Sep 2, 2026Updated 3 weeks ago
- A curation of awesome tools, documents and projects about LLM Security.☆1,705Aug 20, 2025Updated last year
- A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide…☆1,914Jul 12, 2026Updated 2 months ago
- This repository provides a benchmark for prompt injection attacks and defenses in LLMs☆503Updated this week
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆913Sep 1, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…☆465Jan 22, 2025Updated last year
- LLM security and privacy☆54Oct 15, 2024Updated last year
- Universal and Transferable Attacks on Aligned Language Models☆4,806Aug 2, 2024Updated 2 years ago
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆678Apr 4, 2025Updated last year
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆168Nov 30, 2024Updated last year
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆395Jan 23, 2025Updated last year
- ☆791Jul 2, 2025Updated last year
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆1,056Aug 16, 2024Updated 2 years ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆611Feb 27, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding☆153Jul 19, 2024Updated 2 years ago
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆198Apr 1, 2025Updated last year
- [S&P'24] Test-Time Poisoning Attacks Against Test-Time Adaptation Models☆21Feb 18, 2025Updated last year
- A lightweight library for large laguage model (LLM) jailbreaking defense.☆61Sep 11, 2025Updated last year
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆359Feb 23, 2024Updated 2 years ago
- Repository for the Paper (AAAI 2024, Oral) --- Visual Adversarial Examples Jailbreak Large Language Models☆282May 13, 2024Updated 2 years ago
- [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability☆176Dec 18, 2024Updated last year
- [AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts☆217Jun 26, 2025Updated last year
- Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, data…☆1,655Sep 21, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆17Apr 24, 2024Updated 2 years ago
- New ways of breaking app-integrated LLMs☆2,142Jul 17, 2025Updated last year
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆74Oct 23, 2024Updated last year
- Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873☆183May 6, 2024Updated 2 years ago
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆57Aug 17, 2024Updated 2 years ago
- ☆60Jun 13, 2024Updated 2 years ago
- 😎 up-to-date & curated list of awesome Attacks on Large-Vision-Language-Models papers, methods & resources.☆579Updated this week
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆119Jun 13, 2024Updated 2 years ago
- [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents☆144Feb 19, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A fast + lightweight implementation of the GCG algorithm in PyTorch☆356May 13, 2025Updated last year
- [CCS-LAMPS'24] LLM IP Protection Against Model Merging☆16Oct 14, 2024Updated last year
- ☆79Feb 16, 2025Updated last year
- ☆205Nov 26, 2023Updated 2 years ago
- ☆171Sep 2, 2024Updated 2 years ago
- [arXiv:2311.03191] "DeepInception: Hypnotize Large Language Model to Be Jailbreaker"☆178Feb 20, 2024Updated 2 years ago
- An LLM can Fool Itself: A Prompt-Based Adversarial Attack (ICLR 2024)☆117Jan 21, 2025Updated last year