thu-coai / AISafetyLabLinks
AISafetyLab: A comprehensive framework covering safety attack, defense, evaluation and paper list.
☆194Updated 3 months ago
Alternatives and similar repositories for AISafetyLab
Users that are interested in AISafetyLab are comparing it to the libraries listed below
Sorting:
- [ICML 2025] An official source code for paper "FlipAttack: Jailbreak LLMs via Flipping".☆131Updated 3 months ago
- Improved techniques for optimization-based jailbreaking on large language models (ICLR2025)☆119Updated 4 months ago
- ☆97Updated 6 months ago
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆144Updated 8 months ago
- ☆144Updated 11 months ago
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆151Updated 2 months ago
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆165Updated 4 months ago
- Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, data…☆836Updated last week
- Agent Security Bench (ASB)☆102Updated last month
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding☆141Updated last year
- ☆70Updated last year
- [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"☆137Updated 3 months ago
- [COLM 2024] JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and fur…☆75Updated 3 months ago
- Code for "When LLM Meets DRL: Advancing Jailbreaking Efficiency via DRL-guided Search" (NeurIPS 2024)☆9Updated 9 months ago
- [AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts☆160Updated last month
- The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".☆52Updated 9 months ago
- Papers about red teaming LLMs and Multimodal models.☆131Updated 2 months ago
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆693Updated 4 months ago
- YiJian-Comunity: a full-process automated large model safety evaluation tool designed for academic research☆115Updated 9 months ago
- [ICLR 2025 Spotlight] The official implementation of our ICLR2025 paper "AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to…☆293Updated 3 months ago
- Awesome Jailbreak, red teaming arxiv papers (Automatically Update Every 12th hours)☆45Updated this week
- MarkLLM: An Open-Source Toolkit for LLM Watermarking.（EMNLP 2024 System Demonstration)☆522Updated last week
- ☆46Updated 2 months ago
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆63Updated 2 months ago
- Panda Guard is designed for researching jailbreak attacks, defenses, and evaluation algorithms for large language models (LLMs).☆42Updated last week
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆384Updated 4 months ago
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…☆369Updated 6 months ago
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆85Updated 10 months ago
- ☆32Updated 2 months ago
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆63Updated 2 weeks ago