dapurv5 / awesome-red-teaming-llmsLinks
Repository accompanying the paper https://openreview.net/pdf?id=sSAp8ITBpC
☆26Updated last month
Alternatives and similar repositories for awesome-red-teaming-llms
Users that are interested in awesome-red-teaming-llms are comparing it to the libraries listed below
Sorting:
- LLM security and privacy☆48Updated 8 months ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆59Updated 4 months ago
- A prompt injection game to collect data for robust ML research☆62Updated 5 months ago
- Differential Privacy Guide☆20Updated 3 years ago
- Manual Prompt Injection / Red Teaming Tool☆31Updated 9 months ago
- A curated and updated list of relevant articles and repositories on Reinforcement Learning from AI Feedback (RLAIF)☆12Updated last year
- ☆75Updated 7 months ago
- Implementation of BEAST adversarial attack for language models (ICML 2024)☆88Updated last year
- [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability☆155Updated 6 months ago
- ☆34Updated 8 months ago
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆161Updated 3 months ago
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆71Updated last year
- Explore visualization tools for understanding Transformer-based large language models (LLMs)☆13Updated 7 months ago
- The jailbreak-evaluation is an easy-to-use Python package for language model jailbreak evaluation.☆23Updated 8 months ago
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆128Updated last month
- Do you want to learn AI Security but don't know where to start ? Take a look at this map.☆25Updated last year
- This repository provides a benchmark for prompt Injection attacks and defenses☆245Updated last month
- 🐶 A curated list of Web Security materials and resources. With repository stars⭐ and forks🍴☆17Updated this week
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆69Updated last year
- Resources for independent web-workers: SEO, Publishing, Git, Jamstack\SSGs, Linux, etc.☆12Updated 9 months ago
- Codebase for Obfuscated Activations Bypass LLM Latent-Space Defenses☆21Updated 5 months ago
- A re-implementation of the "Red Teaming Language Models with Language Models" paper by Perez et al., 2022☆33Updated last year
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆320Updated 5 months ago
- Collection of Materials on AI Agents☆41Updated last month
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆109Updated last year
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆51Updated 10 months ago
- Build your first apps with 776+ beginner coding projects. Learn programming through guided practice and real-world development.☆19Updated last month
- ☆119Updated last month
- Papers about red teaming LLMs and Multimodal models.☆125Updated last month