Papers from our SoK on Red-Teaming (Accepted at TMLR)
☆52Aug 5, 2026Updated 3 months ago
Alternatives and similar repositories for awesome-red-teaming-llms
Users that are interested in awesome-red-teaming-llms are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official repository for "Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks"☆62Aug 8, 2024Updated 2 years ago
- A curated list of awesome LLM Red Teaming training, resources, and tools.☆148Sep 4, 2025Updated last year
- A Unified Benchmark and Toolbox for Multimodal Jailbreak Attack–Defense Evaluation☆80May 8, 2026Updated 5 months ago
- [NeurIPS 2024] Accelerating Greedy Coordinate Gradient and General Prompt Optimization via Probe Sampling☆35Nov 8, 2024Updated last year
- This repository contains the official code for the paper: "Prompt Injection: Parameterization of Fixed Inputs"☆32Sep 13, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- About Official PyTorch implementation of "Query-Efficient Black-Box Red Teaming via Bayesian Optimization" (ACL'23)☆15Jul 9, 2023Updated 3 years ago
- Official implementation for "RSafe: Incentivizing proactive reasoning to build robust and adaptive LLM safeguards"☆17Jan 31, 2026Updated 9 months ago
- Pytorch implementation of NPAttack☆13Jul 7, 2020Updated 6 years ago
- Code and data to go with the Zhu et al. paper "An Objective for Nuanced LLM Jailbreaks"☆38Jul 2, 2026Updated 4 months ago
- Code Implementation of Adversarial Prompt Evaluation paper☆14Sep 18, 2025Updated last year
- this is for the ACM MM paper---Backdoor Attack on Crowd Counting☆17Jul 10, 2022Updated 4 years ago
- GUI / Computer-Use / Browser Agent 安全论文清单 —— 按攻防轴组织，每篇附中文简介☆59Updated this week
- ☆25Jul 25, 2024Updated 2 years ago
- ☆36Apr 13, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The code for AAAI2023 (Generating Transferable 3D Adversarial Point Cloud via Random Perturbation Factorization)☆12Dec 24, 2022Updated 3 years ago
- Robust Principles: Architectural Design Principles for Adversarially Robust CNNs☆24Jan 13, 2024Updated 2 years ago
- ☆10Sep 9, 2020Updated 6 years ago
- ☆21Jul 16, 2024Updated 2 years ago
- Code for the CVPR 2020 article "Adversarial Vertex mixup: Toward Better Adversarially Robust Generalization"☆13Jul 13, 2020Updated 6 years ago
- Emoji Attack [ICML 2025]☆44Jul 15, 2025Updated last year
- An automated pipeline that leverages LLM's meta-learning capability to iteratively design and refine red-teaming systems without human in…☆32May 24, 2026Updated 5 months ago
- This is the repository that introduces research topics related to protecting intellectual property (IP) of AI from a data-centric perspec…☆23Oct 30, 2023Updated 3 years ago
- ☆20Mar 17, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Jun 12, 2025Updated last year
- Official code for ICML 2024 paper on Persona In-Context Learning (PICLe)☆29Jun 27, 2024Updated 2 years ago
- [NeurIPS 2025] BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks and Defenses on Large Language Models☆337Sep 8, 2026Updated last month
- [ArXiv 2025] Imperceptible Jailbreaking against Large Language Models☆25Oct 7, 2025Updated last year
- Towards Efficient and Effective Adversarial Training, NeurIPS 2021☆15Feb 15, 2022Updated 4 years ago
- This is the code for semi-supervised robust training (SRT).☆18Mar 24, 2023Updated 3 years ago
- The official implementation of USENIX Security'23 paper "Meta-Sift" -- Ten minutes or less to find a 1000-size or larger clean subset on …☆20Apr 27, 2023Updated 3 years ago
- ☆40Oct 15, 2026Updated 3 weeks ago
- ☆14May 25, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The official repository for guided jailbreak benchmark☆34Aug 31, 2026Updated 2 months ago
- Data-Efficient Backdoor Attacks☆20Jun 15, 2022Updated 4 years ago
- The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'☆25May 20, 2025Updated last year
- [ICML 2025] UDora: A Unified Red Teaming Framework against LLM Agents☆40Jun 24, 2025Updated last year
- The offical code implementation of paper "Interpretable Multimodal Misinformation Detection with Logic Reasoning", accepted by Finding of…☆31Feb 5, 2026Updated 8 months ago
- ☆20May 6, 2022Updated 4 years ago
- [ACL 2025] LongSafety: Evaluating Long-Context Safety of Large Language Models☆16Jun 18, 2025Updated last year