controllability / jailbreak-evaluationLinks
The jailbreak-evaluation is an easy-to-use Python package for language model jailbreak evaluation.
☆23Updated 7 months ago
Alternatives and similar repositories for jailbreak-evaluation
Users that are interested in jailbreak-evaluation are comparing it to the libraries listed below
Sorting:
- ☆34Updated 7 months ago
- LLM security and privacy☆48Updated 8 months ago
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆51Updated 10 months ago
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆69Updated last year
- General research for Dreadnode☆23Updated last year
- Implementation of BEAST adversarial attack for language models (ICML 2024)☆88Updated last year
- ☆66Updated 11 months ago
- Whispers in the Machine: Confidentiality in Agentic Systems☆39Updated last month
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆30Updated last week
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆69Updated last year
- A prompt injection game to collect data for robust ML research☆62Updated 5 months ago
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆56Updated 3 months ago
- ☆68Updated last month
- Automated Safety Testing of Large Language Models☆15Updated 4 months ago
- ☆74Updated 7 months ago
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆49Updated 8 months ago
- [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability☆154Updated 6 months ago
- A collection of prompt injection mitigation techniques.☆22Updated last year
- ☆65Updated 5 months ago
- ☆90Updated last year
- This repository provides a benchmark for prompt Injection attacks and defenses☆232Updated 3 weeks ago
- A benchmark for prompt injection detection systems.☆120Updated last month
- [ACL 2025] The official implementation of the paper "InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail M…☆42Updated last month
- Code repo for the paper: Attacking Vision-Language Computer Agents via Pop-ups☆33Updated 6 months ago
- Papers about red teaming LLMs and Multimodal models.☆123Updated last month
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆158Updated 2 months ago
- ☆116Updated 2 weeks ago
- Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers☆52Updated 10 months ago
- [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"☆74Updated last year
- Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"☆42Updated 9 months ago