controllability / jailbreak-evaluation
The jailbreak-evaluation is an easy-to-use Python package for language model jailbreak evaluation.
☆20Updated 3 months ago
Alternatives and similar repositories for jailbreak-evaluation:
Users that are interested in jailbreak-evaluation are comparing it to the libraries listed below
- ☆38Updated 3 weeks ago
- [NDSS'25 Poster] A collection of automated evaluators for assessing jailbreak attempts.☆112Updated this week
- ☆64Updated last month
- ☆34Updated 3 months ago
- ☆28Updated 3 months ago
- LLM security and privacy☆47Updated 4 months ago
- ☆44Updated 9 months ago
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆40Updated 4 months ago
- Implementation of BEAST adversarial attack for language models (ICML 2024)☆79Updated 9 months ago
- ☆19Updated last year
- [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability☆134Updated 2 months ago
- Papers about red teaming LLMs and Multimodal models.☆96Updated 3 months ago
- Weak-to-Strong Jailbreaking on Large Language Models☆72Updated last year
- ☆52Updated 7 months ago
- This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses☆172Updated last month
- A collection of prompt injection mitigation techniques.☆20Updated last year
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆66Updated last year
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆49Updated 6 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆451Updated 4 months ago
- Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers☆46Updated 5 months ago
- ☆77Updated 2 months ago
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆58Updated 3 weeks ago
- ☆164Updated last year
- A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.☆58Updated 10 months ago
- The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…☆92Updated last month
- The opensoure repository of FuzzLLM☆23Updated 9 months ago
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆91Updated 11 months ago
- ☆79Updated last year
- Risks and targets for assessing LLMs & LLM vulnerabilities☆30Updated 8 months ago
- ☆14Updated this week