Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models
☆35Oct 19, 2023Updated 3 years ago
Alternatives and similar repositories for ShadowAlignment
Users that are interested in ShadowAlignment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models☆91May 2, 2025Updated last year
- The official dataset of paper "Goal-Oriented Prompt Attack and Safety Evaluation for LLMs".☆22Feb 5, 2024Updated 2 years ago
- Code for the paper: Rehearsal-free Continual Language Learning via Efficient Parameter Isolation☆13May 16, 2023Updated 3 years ago
- ☆20Jun 21, 2025Updated last year
- We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…☆361Feb 23, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- MINER: Mutual Information based Named Entity Recognition☆37May 24, 2022Updated 4 years ago
- Research slot☆14Apr 16, 2026Updated 6 months ago
- ☆16Jul 17, 2022Updated 4 years ago
- ☆15Jun 13, 2024Updated 2 years ago
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆109Jan 24, 2024Updated 2 years ago
- Accepted to ACL'25 (main)☆12May 19, 2025Updated last year
- Defending Against Backdoor Attacks Using Robust Covariance Estimation☆23Jul 12, 2021Updated 5 years ago
- This repo is reproduction resources for linear alignment paper, still working☆17May 19, 2024Updated 2 years ago
- [ICLR 2022] Boosting Randomized Smoothing with Variance Reduced Classifiers☆11Mar 29, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Membership Inference Attack Using Self Influence Functions☆14Dec 17, 2024Updated last year
- ☆30Aug 12, 2026Updated 2 months ago
- How Robust are Randomized Smoothing based Defenses to Data Poisoning? (CVPR 2021)☆14Jul 16, 2021Updated 5 years ago
- Code for the paper "Deep Partition Aggregation: Provable Defenses against General Poisoning Attacks"☆14Aug 22, 2022Updated 4 years ago
- A re-implementation of the "Red Teaming Language Models with Language Models" paper by Perez et al., 2022☆35Oct 9, 2023Updated 3 years ago
- Code for paper: PoisonPrompt: Backdoor Attack on Prompt-based Large Language Models, IEEE ICASSP 2024. Demo//124.220.228.133:11107☆21Aug 10, 2024Updated 2 years ago
- ☆12Dec 9, 2020Updated 5 years ago
- An easy-to-use Python framework to generate adversarial jailbreak prompts.☆932Sep 1, 2026Updated last month
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Feb 22, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [CIKM 2024] Trojan Activation Attack: Attack Large Language Models using Activation Steering for Safety-Alignment.☆30Jul 29, 2024Updated 2 years ago
- Finetune LLaMA-2-7b-chat to perform safety evaluation of user-bot conversation☆11Jun 2, 2025Updated last year
- our submission for the microsoft membership inference competion at SaTML 2023☆15Apr 5, 2023Updated 3 years ago
- ☆12Feb 1, 2017Updated 9 years ago
- 毕设，分层自嵌入数字水印☆12Sep 2, 2019Updated 7 years ago
- [ACL 2026] A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models☆23Jul 10, 2026Updated 3 months ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆54Jan 15, 2026Updated 9 months ago
- [EMNLP 2023] RethinkingTMSC: An Empirical Study for Target-Oriented Multimodal Sentiment Classification☆10May 16, 2024Updated 2 years ago
- Implementation of the paper "Exploring the Universal Vulnerability of Prompt-based Learning Paradigm" on Findings of NAACL 2022☆32Jul 11, 2022Updated 4 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆16Feb 26, 2025Updated last year
- ☆12May 14, 2024Updated 2 years ago
- ☆21Feb 3, 2025Updated last year
- The code of paper "Toward Optimal LLM Alignments Using Two-Player Games".☆17Jun 20, 2024Updated 2 years ago
- Code for "Backdoor Attacks on Dense Passage Retrievers for Disseminating Misinformation"☆10Nov 11, 2025Updated 11 months ago
- Internal Consistency Regularization (CROW) for LLM Backdoor Elimination - Paper accepted to ICML 2025☆18May 6, 2025Updated last year
- Parallel Bread first Search on Hadoop☆18May 20, 2022Updated 4 years ago