[NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
☆112Aug 7, 2024Updated 2 years ago
Alternatives and similar repositories for LLM-Conversation-Safety
Users that are interested in LLM-Conversation-Safety are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A curated list of safety-related papers, articles, and resources focused on Large Language Models (LLMs). This repository aims to provide…☆1,901Jul 12, 2026Updated last month
- A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).☆2,070Updated this week
- Official Code for ACL 2023 paper: "Ethicist: Targeted Training Data Extraction Through Loss Smoothed Soft Prompting and Calibrated Confid…☆24May 8, 2023Updated 3 years ago
- [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models☆90May 2, 2025Updated last year
- Towards Safe LLM with our simple-yet-highly-effective Intention Analysis Prompting☆21Mar 25, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [ACL'24, Outstanding Paper] Emulated Disalignment: Safety Alignment for Large Language Models May Backfire!☆39Aug 2, 2024Updated 2 years ago
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆358Feb 23, 2024Updated 2 years ago
- ☆771Jul 2, 2025Updated last year
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆343Jun 7, 2024Updated 2 years ago
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆660Apr 4, 2025Updated last year
- A Domain-Specific Language, Jailbreak Attack Synthesizer and Dynamic LLM Redteaming Toolkit☆28Dec 5, 2024Updated last year
- ☆81Jan 21, 2026Updated 7 months ago
- ☆24Dec 8, 2024Updated last year
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆72May 22, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]☆394Jan 23, 2025Updated last year
- Papers and resources related to the security and privacy of LLMs 🤖☆582Jun 8, 2025Updated last year
- ☆19Oct 2, 2023Updated 2 years ago
- [ACL 25] SafeChain: Safety of Language Models with Long Chain-of-Thought Reasoning Capabilities☆30Apr 2, 2025Updated last year
- Universal and Transferable Attacks on Aligned Language Models☆4,776Aug 2, 2024Updated 2 years ago
- Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment☆111Mar 8, 2024Updated 2 years ago
- [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"☆108Mar 7, 2024Updated 2 years ago
- ICCV 2023 - AdaptGuard: Defending Against Universal Attacks for Model Adaptation☆11Dec 23, 2023Updated 2 years ago
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆896Mar 30, 2026Updated 5 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆172Sep 2, 2024Updated last year
- [ICML 2024] TrustLLM: Trustworthiness in Large Language Models☆630Jun 24, 2025Updated last year
- ☆20Oct 28, 2025Updated 10 months ago
- ☆60Jun 13, 2024Updated 2 years ago
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…☆458Jan 22, 2025Updated last year
- ☆13Jun 17, 2024Updated 2 years ago
- ☆15Apr 27, 2024Updated 2 years ago
- [ICML 2025] Emergent Response Planning in LLMs☆20Jul 1, 2025Updated last year
- [AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts☆212Jun 26, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆297Jul 28, 2025Updated last year
- The code implementation of MuScleLoRA (Accepted in ACL 2024)☆10Dec 1, 2024Updated last year
- [ACL'24] Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization☆101Aug 20, 2024Updated 2 years ago
- ☆11Oct 3, 2021Updated 4 years ago
- ☆12Jan 28, 2023Updated 3 years ago
- code released for our TIP 2021 paper "Adversarial Domain Adaptation with Prototype-based Normalized Output Conditioner"☆15May 24, 2023Updated 3 years ago
- [COLM 2024] JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and fur…☆96May 9, 2025Updated last year