MurrayTom / SG-Bench
SG-Bench: Evaluating LLM Safety Generalization Across Diverse Tasks and Prompt Types
☆13Updated 4 months ago
Alternatives and similar repositories for SG-Bench:
Users that are interested in SG-Bench are comparing it to the libraries listed below
- Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"☆90Updated 7 months ago
- [ACL 2024] Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization☆22Updated 9 months ago
- S-Eval: Automatic and Adaptive Test Generation for Benchmarking Safety Evaluation of Large Language Models☆62Updated last week
- Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)☆51Updated last month
- ☆21Updated 6 months ago
- 🔥🔥🔥Breaking long thought processes of o1-like LLMs, such as DeepSeek-R1, QwQ☆28Updated last month
- [COLM 2024] JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and fur…☆55Updated this week
- R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)☆74Updated 2 weeks ago
- Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)☆60Updated 3 months ago
- 【ACL 2024】 SALAD benchmark & MD-Judge☆144Updated last month
- ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.☆80Updated 11 months ago
- [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning☆91Updated 11 months ago
- Accepted by ECCV 2024☆125Updated 6 months ago
- Code for paper "Defending aginast LLM Jailbreaking via Backtranslation"☆29Updated 8 months ago
- RWKU: Benchmarking Real-World Knowledge Unlearning for Large Language Models. NeurIPS 2024☆72Updated 6 months ago
- [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"☆72Updated last year
- ☆38Updated 3 weeks ago
- Official repository for "Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks"☆51Updated 8 months ago
- A lightweight library for large laguage model (LLM) jailbreaking defense.☆51Updated 6 months ago
- Weak-to-Strong Jailbreaking on Large Language Models☆73Updated last year
- Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]☆70Updated 7 months ago
- Awesome Large Reasoning Model(LRM) Safety.This repository is used to collect security-related research on large reasoning models such as …☆63Updated this week
- Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding☆129Updated 9 months ago
- ☆63Updated 3 months ago
- ☆21Updated last month
- Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT☆33Updated last year
- ☆46Updated 10 months ago
- The reinforcement learning codes for dataset SPA-VL☆32Updated 10 months ago
- [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"☆58Updated 6 months ago
- Code and data for paper "Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation?".☆13Updated 2 months ago