Alternatives and similar repositories for misalignment

Users that are interested in misalignment are comparing it to the libraries listed below

• Lyz1213 / BadEdit
  ☆37Updated last year
• tmllab / 2025_ICLR_PiF
  ☆37Updated 7 months ago
• Django-Jiang / BadChain
  [ICLR24] Official Repo of BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models
  ☆44Updated last year
• Gwinhen / DRUPE
  Distribution Preserving Backdoor Attack in Self-supervised Learning
  ☆20Updated last year
• NY1024 / BAP-Jailbreak-Vision-Language-Models-via-Bi-Modal-Adversarial-Prompt
  ☆55Updated last year
• cnut1648 / Model-Fingerprint
  Fingerprint large language models
  ☆47Updated last year
• KaiyuanZh / SOFT
  [USENIX Security 2025] SOFT: Selective Data Obfuscation for Protecting LLM Fine-tuning against Membership Inference Attacks
  ☆16Updated 3 months ago
• RUCAIBox / HADES
  [ECCV'24 Oral] The official GitHub page for ''Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking …
  ☆34Updated last year
• qingjiesjtu / USC
  This is the code repository of our submission: Understanding the Dark Side of LLMs’ Intrinsic Self-Correction.
  ☆63Updated last year
• clearloveclearlove / BEAT
  ☆14Updated 10 months ago
• inspire-group / RobustRAG
  ☆21Updated last year
• TeamPigeonLab / CS-DJ
  Accept by CVPR 2025 (highlight)
  ☆22Updated 7 months ago
• grasses / PoisonPrompt
  Code for paper: PoisonPrompt: Backdoor Attack on Prompt-based Large Language Models, IEEE ICASSP 2024. Demo//124.220.228.133:11107
  ☆19Updated last year
• wanlunsec / Beatrix
  ☆27Updated 2 years ago
• meng-wenlong / LMSanitator
  ☆27Updated 2 years ago
• PurduePAML / DBS
  ☆18Updated 3 years ago
• Eyr3 / TextCRS
  Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks (IEEE S&P 2024)
  ☆34Updated 6 months ago
• wagner-group / MarkMyWords
  ☆32Updated last year
• shiningrain / JailGuard
  ☆24Updated 9 months ago
• thu-coai / JailbreakDefense_GoalPriority
  [ACL 2024] Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization
  ☆29Updated last year
• zhipeng-wei / EmojiAttack
  Emoji Attack [ICML 2025]
  ☆40Updated 5 months ago
• lancopku / codable-watermarking-for-llm
  Repository for Towards Codable Watermarking for Large Language Models
  ☆38Updated 2 years ago
• yxoh / prompt_leak_usenix2024
  ☆13Updated last year
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆105Updated last year
• zhangrui4041 / Instruction_Backdoor_Attack
  ☆26Updated last year
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆75Updated last year
• yuplin2333 / representation-space-jailbreak
  Code repo of our paper Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (https://arxiv.org/abs/2406.10794…
  ☆23Updated last year
• ybwang119 / label_recovery
  [ICLR 2024] Towards Elminating Hard Label Constraints in Gradient Inverision Attacks
  ☆14Updated last year
• zihao-ai / unthinking_vulnerability
  To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
  ☆32Updated 7 months ago
• papersPapers / BadPrompt
  Code for the paper "BadPrompt: Backdoor Attacks on Continuous Prompts"
  ☆40Updated last year