RobustNLP / CipherChatLinks
A framework to evaluate the generalization capability of safety alignment for LLMs
☆613Updated 8 months ago
Alternatives and similar repositories for CipherChat
Users that are interested in CipherChat are comparing it to the libraries listed below
Sorting:
- "他山之石、可以攻玉"：复旦白泽智能发布面向国内开源和国外商用大模型的Demo数据集JADE-DB☆443Updated 2 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆521Updated 11 months ago
- Official github repo for SafetyBench, a comprehensive benchmark to evaluate LLMs' safety. [ACL 2024]☆245Updated last month
- [ICLR 2024] The official implementation of our ICLR2024 paper "AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language M…☆374Updated 7 months ago
- [arXiv:2311.03191] "DeepInception: Hypnotize Large Language Model to Be Jailbreaker"☆161Updated last year
- Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!☆317Updated 10 months ago
- The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…☆128Updated 7 months ago
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆706Updated 5 months ago
- ShieldLM: Empowering LLMs as Aligned, Customizable and Explainable Safety Detectors [EMNLP 2024 Findings]☆208Updated 11 months ago
- ☆147Updated last year
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆318Updated last year
- Papers and resources related to the security and privacy of LLMs 🤖☆528Updated 2 months ago
- [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey☆106Updated last year
- 面向中文大模型价值观的评估与对齐研究☆533Updated 2 years ago
- ☆181Updated last year
- Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)☆144Updated 9 months ago
- 【ACL 2024】 SALAD benchmark & MD-Judge☆158Updated 5 months ago
- [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.☆167Updated 5 months ago
- JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]☆400Updated 4 months ago
- Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。☆1,067Updated last year
- S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Models☆94Updated 2 months ago
- PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…☆410Updated last year
- ☆159Updated 7 months ago
- Awesome LLM Jailbreak academic papers☆103Updated last year
- BeaverTails is a collection of datasets designed to facilitate research on safety alignment in large language models (LLMs).☆154Updated last year
- Code and data of the EMNLP 2022 paper "Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversaria…☆54Updated 2 years ago
- SC-Safety: 中文大模型多轮对抗安全基准☆142Updated last year
- ☆604Updated 2 months ago
- [ICML 2024] TrustLLM: Trustworthiness in Large Language Models☆589Updated 2 months ago
- Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs☆281Updated last year