[NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
☆112Aug 7, 2024Updated 2 years ago
Alternatives and similar repositories for LLM-Conversation-Safety
Users that are interested in LLM-Conversation-Safety are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide…☆1,911Jul 12, 2026Updated 2 months ago
- A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).☆2,078Sep 2, 2026Updated 2 weeks ago
- Official Code for ACL 2023 paper: "Ethicist: Targeted Training Data Extraction Through Loss Smoothed Soft Prompting and Calibrated Confid…☆24May 8, 2023Updated 3 years ago
- [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models☆91May 2, 2025Updated last year
- Towards Safe LLM with our simple-yet-highly-effective Intention Analysis Prompting☆21Mar 25, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [ACL'24, Outstanding Paper] Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!☆39Aug 2, 2024Updated 2 years ago
- Ferret: Faster and Effective Automated Red Teaming with Reward-Based Scoring Technique☆19Aug 22, 2024Updated 2 years ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆359Feb 23, 2024Updated 2 years ago
- ☆56Dec 24, 2024Updated last year
- ☆786Jul 2, 2025Updated last year
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆344Jun 7, 2024Updated 2 years ago
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆673Apr 4, 2025Updated last year
- ☆24Dec 8, 2024Updated last year
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆72May 22, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Papers and resources related to the security and privacy of LLMs 🤖☆583Jun 8, 2025Updated last year
- ☆19Oct 2, 2023Updated 2 years ago
- [ACL 25] SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities☆30Apr 2, 2025Updated last year
- Universal and Transferable Attacks on Aligned Language Models☆4,800Aug 2, 2024Updated 2 years ago
- [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"☆108Mar 7, 2024Updated 2 years ago
- Code and data to go with the Zhu et al. paper "An Objective for Nuanced LLM Jailbreaks"☆37Jul 2, 2026Updated 2 months ago
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆909Sep 1, 2026Updated 2 weeks ago
- ☆172Sep 2, 2024Updated 2 years ago
- [ICML 2024] TrustLLM: Trustworthiness in Large Language Models☆633Jun 24, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆20Oct 28, 2025Updated 10 months ago
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆168Nov 30, 2024Updated last year
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…☆464Jan 22, 2025Updated last year
- ☆13Jun 17, 2024Updated 2 years ago
- ☆15Apr 27, 2024Updated 2 years ago
- [ICML 2025] Emergent Response Planning in LLMs☆21Jul 1, 2025Updated last year
- [AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts☆216Jun 26, 2025Updated last year
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆296Jul 28, 2025Updated last year
- R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)☆114Jan 11, 2026Updated 8 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆20Mar 25, 2024Updated 2 years ago
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆101Aug 20, 2024Updated 2 years ago
- ☆11Oct 3, 2021Updated 4 years ago
- ☆12Jan 28, 2023Updated 3 years ago
- code released for our TIP 2021 paper "Adversarial Domain Adaptation with Prototype-based Normalized Output Conditioner"☆15May 24, 2023Updated 3 years ago
- [COLM 2024] JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and fur…☆98May 9, 2025Updated last year
- Code for our NeurIPS 2023 paper Towards Evaluating Transfer-based Attacks Systematically, Practically, and Fairly☆14Jan 22, 2024Updated 2 years ago