Alternatives and similar repositories for misalignment

Users that are interested in misalignment are comparing it to the libraries listed below

• Lyz1213 / BadEdit
  ☆37Updated last year
• cnut1648 / Model-Fingerprint
  Fingerprint large language models
  ☆49Updated last year
• inspire-group / RobustRAG
  ☆23Updated last year
• NY1024 / BAP-Jailbreak-Vision-Language-Models-via-Bi-Modal-Adversarial-Prompt
  ☆57Updated last year
• Django-Jiang / BadChain
  [ICLR24] Official Repo of BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models
  ☆47Updated last year
• RUCAIBox / HADES
  [ECCV'24 Oral] The official GitHub page for ''Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking …
  ☆34Updated last year
• qingjiesjtu / USC
  This is the code repository of our submission: Understanding the Dark Side of LLMs’ Intrinsic Self-Correction.
  ☆63Updated last year
• tmllab / 2025_ICLR_PiF
  ☆38Updated 8 months ago
• wagner-group / MarkMyWords
  ☆32Updated last year
• Eyr3 / TextCRS
  Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks (IEEE S&P 2024)
  ☆34Updated 7 months ago
• lancopku / codable-watermarking-for-llm
  Repository for Towards Codable Watermarking for Large Language Models
  ☆37Updated 2 years ago
• PurduePAML / DBS
  ☆18Updated 3 years ago
• Gwinhen / DRUPE
  Distribution Preserving Backdoor Attack in Self-supervised Learning
  ☆20Updated 2 years ago
• clearloveclearlove / BEAT
  ☆14Updated 11 months ago
• KaiyuanZh / SOFT
  [USENIX Security 2025] SOFT: Selective Data Obfuscation for Protecting LLM Fine-tuning against Membership Inference Attacks
  ☆19Updated 4 months ago
• TeamPigeonLab / CS-DJ
  Accept by CVPR 2025 (highlight)
  ☆22Updated 7 months ago
• WUSTL-CSPL / LLMJailbreak
  ☆37Updated last year
• OSU-NLP-Group / EIA_against_webagent
  ☆37Updated last year
• CryptoAILab / MergeGuard
  [CCS-LAMPS'24] LLM IP Protection Against Model Merging
  ☆16Updated last year
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆109Updated last year
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆75Updated last year
• shiningrain / JailGuard
  ☆25Updated 10 months ago
• PKU-ML / PAT
  Code for NeurIPS 2024 Paper "Fight Back Against Jailbreaking via Prompt Adversarial Tuning"
  ☆22Updated 9 months ago
• llm-editing / editing-attack
  Code and dataset for the paper: "Can Editing LLMs Inject Harm?"
  ☆21Updated last month
• thunxxx / MLLM-Jailbreak-evaluation-MMJ-Bench
  ☆71Updated 10 months ago
• wanlunsec / Beatrix
  ☆27Updated 3 years ago
• AI45Lab / CodeAttack
  [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion
  ☆58Updated 4 months ago
• XuanChen-xc / RLbreaker
  Code for "When LLM Meets DRL: Advancing Jailbreaking Efficiency via DRL-guided Search" (NeurIPS 2024)
  ☆17Updated last year
• AI-secure / MMDT
  Comprehensive Assessment of Trustworthiness in Multimodal Foundation Models
  ☆25Updated 10 months ago
• shaoshuo-ss / EaaW
  [NDSS 2025] Official code for our paper "Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Wate…
  ☆45Updated last year