Alternatives and similar repositories for latent_adversarial_training

Users that are interested in latent_adversarial_training are comparing it to the libraries listed below

• aengusl / latent-adversarial-training
  ☆43Updated last year
• rishub-tamirisa / tamper-resistance
  [ICLR 2025] Official Repository for "Tamper-Resistant Safeguards for Open-Weight LLMs"
  ☆62Updated 4 months ago
• locuslab / acr-memorization
  ☆37Updated 10 months ago
• ejones313 / auditing-llms
  ☆58Updated 2 years ago
• ethz-spylab / rlhf-poisoning
  Code for paper "Universal Jailbreak Backdoors from Poisoned Human Feedback"
  ☆61Updated last year
• milesaturpin / cot-unfaithfulness
  ☆48Updated 2 years ago
• centerforaisafety / tdc2023-starter-kit
  This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.
  ☆89Updated last year
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆65Updated 9 months ago
• ykwon0407 / DataInf
  DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (ICLR 2024)
  ☆76Updated last year
• ethz-spylab / autoadvexbench
  ☆33Updated 5 months ago
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆82Updated 7 months ago
• max-andr / adversarial-random-search-gpt4
  Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]
  ☆43Updated last year
• princeton-polaris-lab / Evaluating-Durable-Safeguards
  [ICLR 2025] On Evluating the Durability of Safegurads for Open-Weight LLMs
  ☆13Updated 4 months ago
• azshue / AutoPoison
  The official repository of the paper "On the Exploitability of Instruction Tuning".
  ☆66Updated last year
• McGill-NLP / AdversarialTriggers
  TACL 2025: Investigating Adversarial Trigger Transfer in Large Language Models
  ☆19Updated 2 months ago
• BrachioLab / adversarial_prompting
  ☆53Updated 2 years ago
• swj0419 / muse_bench
  ☆28Updated 7 months ago
• VITA-Group / Robust_Weight_Signatures
  [ICML 2023] "Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?" by Ruisi Cai, Zhenyu Zhang, Zhangyang Wang
  ☆16Updated 2 years ago
• paul-rottger / xstest
  Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"
  ☆116Updated 8 months ago
• MadryLab / journey-TRAK
  Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"
  ☆25Updated last year
• rotaryhammer / code-autodan
  An unofficial implementation of AutoDAN attack on LLMs (arXiv:2310.15140)
  ☆44Updated last year
• licong-lin / negative-preference-optimization
  ☆66Updated last year
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated 2 years ago
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆115Updated last year
• git-disl / Safety-Tax
  This is the official code for the paper "Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable".
  ☆26Updated 7 months ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆105Updated 2 years ago
• mueller-mp / SAM-ON
  ☆34Updated last year
• SORRY-Bench / sorry-bench
  Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)
  ☆62Updated 7 months ago
• MadryLab / trak
  A fast, effective data attribution method for neural networks in PyTorch
  ☆220Updated 11 months ago
• boyiwei / alignment-attribution-code
  [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications
  ☆85Updated 6 months ago