NLie2 / what_features_jailbreak_LLMsLinks
☆17Updated 6 months ago
Alternatives and similar repositories for what_features_jailbreak_LLMs
Users that are interested in what_features_jailbreak_LLMs are comparing it to the libraries listed below
Sorting:
- ☆21Updated last year
- [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models☆86Updated 5 months ago
- ☆185Updated last year
- [ICML 2024] Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast☆114Updated last year
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆65Updated 9 months ago
- [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents☆110Updated 8 months ago
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆72Updated 3 months ago
- Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers☆64Updated last year
- ☆32Updated last year
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆146Updated 4 months ago
- ☆24Updated last year
- [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"☆62Updated 4 months ago
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆69Updated 5 months ago
- Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs☆92Updated 10 months ago
- ☆23Updated 9 months ago
- All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks☆18Updated last year
- Official repository for "Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks"☆58Updated last year
- ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆87Updated last year
- ☆63Updated 6 months ago
- Code repo of our paper Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (https://arxiv.org/abs/2406.10794…☆22Updated last year
- Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives☆69Updated last year
- PAL: Proxy-Guided Black-Box Attack on Large Language Models☆55Updated last year
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆60Updated last year
- Code for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder" in NMI.☆53Updated last year
- [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability☆166Updated 10 months ago
- The official repository of the paper "On the Exploitability of Instruction Tuning".☆66Updated last year
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆116Updated 8 months ago
- ☆25Updated last year
- This repo is for the safety topic, including attacks, defenses and studies related to reasoning and RL☆46Updated last month
- Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873☆168Updated last year