thu-coai / AISafetyLabLinks
AISafetyLab: A comprehensive framework covering safety attack, defense, evaluation and paper list.
☆208Updated 2 months ago
Alternatives and similar repositories for AISafetyLab
Users that are interested in AISafetyLab are comparing it to the libraries listed below
Sorting:
- [ICML 2025] An official source code for paper "FlipAttack: Jailbreak LLMs via Flipping".☆149Updated 6 months ago
- Improved techniques for optimization-based jailbreaking on large language models (ICLR2025)☆132Updated 6 months ago
- [ICLR Workshop 2025] An official source code for paper "GuardReasoner: Towards Reasoning-based LLM Safeguards".☆158Updated 5 months ago
- [ICLR 2025 Spotlight] The official implementation of our ICLR2025 paper "AutoDAN-Turbo: A Lifelong Agent for Strategy Self-Exploration to…☆313Updated 3 weeks ago
- ☆109Updated 9 months ago
- Agent Security Bench (ASB)☆137Updated 3 weeks ago
- ☆153Updated last year
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆152Updated 11 months ago
- ☆42Updated 5 months ago
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding☆146Updated last year
- [COLM 2024] JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and fur…☆80Updated 5 months ago
- YiJian-Comunity: a full-process automated large model safety evaluation tool designed for academic research☆114Updated last year
- [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"☆162Updated 6 months ago
- MarkLLM: An Open-Source Toolkit for LLM Watermarking.(EMNLP 2024 System Demonstration)☆637Updated 2 weeks ago
- Awesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, data…☆1,009Updated last week
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆172Updated 7 months ago
- [AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts☆177Updated 4 months ago
- Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"☆72Updated 3 months ago
- ☆46Updated 7 months ago
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆446Updated 6 months ago
- ☆42Updated 6 months ago
- [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion☆54Updated last month
- [CCS'24] SafeGen: Mitigating Unsafe Content Generation in Text-to-Image Models☆137Updated 4 months ago
- Awesome Large Reasoning Model(LRM) Safety.This repository is used to collect security-related research on large reasoning models such as …☆76Updated this week
- TAP: An automated jailbreaking method for black-box LLMs☆194Updated 10 months ago
- ☆69Updated 2 months ago
- Panda Guard is designed for researching jailbreak attacks, defenses, and evaluation algorithms for large language models (LLMs).☆50Updated 2 weeks ago
- ☆36Updated 5 months ago
- The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.☆478Updated 3 months ago
- Awesome Jailbreak, red teaming arxiv papers (Automatically Update Every 12th hours)☆70Updated last week