Alternatives and similar repositories for misalignment

Users that are interested in misalignment are comparing it to the libraries listed below

• DeepLearningSecurityGroup / Cyber_Security_Reading_Group
  ☆14Updated this week
• qingjiesjtu / USC
  This is the code repository of our submission: Understanding the Dark Side of LLMs’ Intrinsic Self-Correction.
  ☆61Updated 8 months ago
• wagner-group / MarkMyWords
  ☆30Updated last year
• wanlunsec / Beatrix
  ☆24Updated 2 years ago
• Lyz1213 / BadEdit
  ☆33Updated 10 months ago
• NY1024 / BAP-Jailbreak-Vision-Language-Models-via-Bi-Modal-Adversarial-Prompt
  ☆50Updated last year
• PurduePAML / DBS
  ☆18Updated 3 years ago
• yxoh / prompt_leak_usenix2024
  ☆13Updated last year
• Gwinhen / DRUPE
  Distribution Preserving Backdoor Attack in Self-supervised Learning
  ☆16Updated last year
• reds-lab / Meta-Sift
  The official implementation of USENIX Security'23 paper "Meta-Sift" -- Ten minutes or less to find a 1000-size or larger clean subset on …
  ☆19Updated 2 years ago
• WUSTL-CSPL / LLMJailbreak
  ☆35Updated 11 months ago
• inspire-group / RobustRAG
  ☆19Updated 11 months ago
• NY1024 / Foundation-Model-Paper-Notes
  ☆59Updated 3 months ago
• Eyr3 / TextCRS
  Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks (IEEE S&P 2024)
  ☆34Updated 2 months ago
• AI-secure / MMDT
  Comprehensive Assessment of Trustworthiness in Multimodal Foundation Models
  ☆22Updated 5 months ago
• RU-System-Software-and-Security / FeatureRE
  ☆27Updated 2 years ago
• verazuo / prompt-stealing-attack
  [USENIX'24] Prompt Stealing Attacks Against Text-to-Image Generation Models
  ☆43Updated 7 months ago
• zhangrui4041 / Instruction_Backdoor_Attack
  ☆25Updated last year
• tmllab / 2025_ICLR_PiF
  ☆30Updated 3 months ago
• Gwinhen / BackdoorVault
  A toolbox for backdoor attacks.
  ☆22Updated 2 years ago
• PKU-ML / PAT
  Code for NeurIPS 2024 Paper "Fight Back Against Jailbreaking via Prompt Adversarial Tuning"
  ☆16Updated 3 months ago
• lancopku / codable-watermarking-for-llm
  Repository for Towards Codable Watermarking for Large Language Models
  ☆38Updated last year
• Django-Jiang / BadChain
  [ICLR24] Official Repo of BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models
  ☆37Updated last year
• mengtong0110 / InferDPT
  ☆31Updated 4 months ago
• umd-huang-lab / VLM-Poisoning
  Code for Neurips 2024 paper "Shadowcast: Stealthy Data Poisoning Attacks Against Vision-Language Models"
  ☆53Updated 7 months ago
• rain152 / PAT
  [NeurIPS 2024] Fight Back Against Jailbreaking via Prompt Adversarial Tuning
  ☆10Updated 10 months ago
• ybwang119 / label_recovery
  [ICLR 2024] Towards Elminating Hard Label Constraints in Gradient Inverision Attacks
  ☆13Updated last year
• bboylyg / RNP
  Reconstructive Neuron Pruning for Backdoor Defense (ICML 2023)
  ☆39Updated last year
• JunfengGo / SCALE-UP
  ☆24Updated last year
• zihao-ai / unthinking_vulnerability
  To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
  ☆31Updated 3 months ago