CHATS-lab / persuasive_jailbreaker
Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!
☆259Updated last month
Related projects ⓘ
Alternatives and complementary repositories for persuasive_jailbreaker
- ☆413Updated 3 months ago
- The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models".☆245Updated 3 weeks ago
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]☆220Updated 2 months ago
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆232Updated last month
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆313Updated 8 months ago
- TAP: An automated jailbreaking method for black-box LLMs☆119Updated 8 months ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆241Updated 8 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆403Updated last month
- A collection of automated evaluators for assessing jailbreak attempts.☆75Updated 4 months ago
- ☆153Updated 11 months ago
- Papers about red teaming LLMs and Multimodal models.☆78Updated last month
- Improving Alignment and Robustness with Circuit Breakers☆154Updated last month
- A Comprehensive Assessment of Trustworthiness in GPT Models☆260Updated 2 months ago
- ☆91Updated 2 months ago
- HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal☆341Updated 3 months ago
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆115Updated 8 months ago
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆184Updated 5 months ago
- Red-Teaming Language Models with DSPy☆142Updated 7 months ago
- Code for the website www.jailbreakchat.com☆74Updated last year
- This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses☆146Updated 2 months ago
- Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873☆122Updated 6 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆123Updated last month
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆79Updated 8 months ago
- [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability☆110Updated 2 months ago
- Papers and resources related to the security and privacy of LLMs 🤖☆433Updated 2 months ago
- A fast + lightweight implementation of the GCG algorithm in PyTorch☆127Updated last month
- The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…☆74Updated 4 months ago
- Weak-to-Strong Jailbreaking on Large Language Models☆67Updated 9 months ago
- ☆34Updated 3 months ago
- Official Implementation of InstructZero; the first framework to optimize bad prompts of ChatGPT(API LLMs) and finally obtain good prompts…☆180Updated 3 months ago