Aatrox103 / SAP
☆37Updated 4 months ago
Related projects: ⓘ
- [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"☆50Updated 6 months ago
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆76Updated 6 months ago
- Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT☆20Updated 11 months ago
- AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM☆33Updated 3 weeks ago
- ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆61Updated 4 months ago
- [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey☆65Updated last month
- ☆31Updated 3 months ago
- Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"☆64Updated 2 weeks ago
- Papers about red teaming LLMs and Multimodal models.☆66Updated this week
- A re-implementation of the "Red Teaming Language Models with Language Models" paper by Perez et al., 2022☆24Updated 11 months ago
- The official dataset of paper "Goal-Oriented Prompt Attack and Safety Evaluation for LLMs".☆15Updated 7 months ago
- Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers☆26Updated 3 weeks ago
- Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"☆20Updated last month
- An unofficial implementation of AutoDAN attack on LLMs (arXiv:2310.15140)☆27Updated 7 months ago
- Awesome LLM Jailbreak academic papers☆61Updated 10 months ago
- A collection of automated evaluators for assessing jailbreak attempts.☆55Updated 2 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆79Updated 3 months ago
- 【ACL 2024】 SALAD benchmark & MD-Judge☆81Updated this week
- Fine-tuning base models to build robust task-specific models☆23Updated 5 months ago
- Code and data of the EMNLP 2022 paper "Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversaria…☆32Updated last year
- ☆143Updated 9 months ago
- ☆27Updated 3 months ago
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆27Updated 5 months ago
- This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses☆125Updated 2 weeks ago
- R-Judge: Benchmarking Safety Risk Awareness for LLM Agents☆57Updated last month
- ☆23Updated last year
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NextGenAISafety @ ICML 2024)☆37Updated last month
- Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLM☆13Updated 3 months ago
- Weak-to-Strong Jailbreaking on Large Language Models☆62Updated 6 months ago
- Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"☆36Updated last month