Alternatives and similar repositories for misalignment

Users that are interested in misalignment are comparing it to the libraries listed below

• TeamPigeonLab / CS-DJ
  Accept by CVPR 2025 (highlight)
  ☆21Updated 6 months ago
• Lyz1213 / BadEdit
  ☆37Updated last year
• tmllab / 2025_ICLR_PiF
  ☆37Updated 7 months ago
• WUSTL-CSPL / LLMJailbreak
  ☆37Updated last year
• Django-Jiang / BadChain
  [ICLR24] Official Repo of BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models
  ☆44Updated last year
• inspire-group / RobustRAG
  ☆21Updated last year
• Gwinhen / DRUPE
  Distribution Preserving Backdoor Attack in Self-supervised Learning
  ☆20Updated last year
• yxoh / prompt_leak_usenix2024
  ☆13Updated last year
• NY1024 / BAP-Jailbreak-Vision-Language-Models-via-Bi-Modal-Adversarial-Prompt
  ☆52Updated last year
• RUCAIBox / HADES
  [ECCV'24 Oral] The official GitHub page for ''Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking …
  ☆32Updated last year
• qingjiesjtu / USC
  This is the code repository of our submission: Understanding the Dark Side of LLMs’ Intrinsic Self-Correction.
  ☆63Updated last year
• cnut1648 / Model-Fingerprint
  Fingerprint large language models
  ☆47Updated last year
• clearloveclearlove / BEAT
  ☆14Updated 9 months ago
• wagner-group / MarkMyWords
  ☆32Updated last year
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆103Updated last year
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆75Updated last year
• AI-secure / MMDT
  Comprehensive Assessment of Trustworthiness in Multimodal Foundation Models
  ☆25Updated 9 months ago
• PurduePAML / DBS
  ☆18Updated 3 years ago
• Eyr3 / TextCRS
  Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks (IEEE S&P 2024)
  ☆34Updated 5 months ago
• OSU-NLP-Group / EIA_against_webagent
  ☆37Updated last year
• xyq7 / GradSafe
  Official Code for ACL 2024 paper "GradSafe: Detecting Unsafe Prompts for LLMs via Safety-Critical Gradient Analysis"
  ☆60Updated last year
• umd-huang-lab / VLM-Poisoning
  Code for Neurips 2024 paper "Shadowcast: Stealthy Data Poisoning Attacks Against Vision-Language Models"
  ☆58Updated 11 months ago
• AI45Lab / ActorAttack
  ☆113Updated 10 months ago
• PKU-ML / PAT
  Code for NeurIPS 2024 Paper "Fight Back Against Jailbreaking via Prompt Adversarial Tuning"
  ☆22Updated 7 months ago
• Sizhe-Chen / StruQ
  official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries
  ☆55Updated last month
• wanlunsec / Beatrix
  ☆27Updated 2 years ago
• zihao-ai / unthinking_vulnerability
  To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
  ☆32Updated 6 months ago
• shaoshuo-ss / EaaW
  [NDSS 2025] Official code for our paper "Explanation as a Watermark: Towards Harmless and Multi-bit Model Ownership Verification via Wate…
  ☆45Updated last year
• reds-lab / Meta-Sift
  The official implementation of USENIX Security'23 paper "Meta-Sift" -- Ten minutes or less to find a 1000-size or larger clean subset on …
  ☆20Updated 2 years ago
• mengtong0110 / InferDPT
  ☆32Updated last month