Alternatives and similar repositories for rlhf-trojan-competition-submission:

Users that are interested in rlhf-trojan-competition-submission are comparing it to the libraries listed below

• thestephencasper / explore_establish_exploit_llms
  ☆31Updated last year
• ejones313 / auditing-llms
  ☆52Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated last week
• SchwinnL / circuit-breakers-eval
  Independent robustness evaluation of Improving Alignment and Robustness with Short Circuiting
  ☆13Updated 5 months ago
• facebookresearch / jailbreak-objectives
  Code and data to go with the Zhu et al. paper "An Objective for Nuanced LLM Jailbreaks"
  ☆22Updated last month
• locuslab / acr-memorization
  ☆30Updated last month
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆66Updated 11 months ago
• sail-sg / Cheating-LLM-Benchmarks
  [SafeGenAi @ NeurIPS 2024] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates
  ☆68Updated 3 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆40Updated last year
• weizeming / momentum-attack-llm
  ☆16Updated last week
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆53Updated 2 weeks ago
• jiahai-feng / binding-iclr
  ☆12Updated 10 months ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆28Updated 6 months ago
• vfleaking / PTST
  Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"
  ☆17Updated 10 months ago
• VITA-Group / Robust_Weight_Signatures
  [ICML 2023] "Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights?" by Ruisi Cai, Zhenyu Zhang, Zhangyang Wang
  ☆15Updated last year
• OSU-NLP-Group / AgentAttack
  ☆17Updated 3 months ago
• Jayfeather1024 / Backdoor-Enhanced-Alignment
  ☆15Updated last month
• zzwjames / FailureLLMUnlearning
  ☆23Updated 2 months ago
• ml-research / LlavaGuard
  ☆33Updated 5 months ago
• arobey1 / advbench
  ☆39Updated last year
• max-andr / adversarial-random-search-gpt4
  Adversarial Attacks on GPT-4 via Simple Random Search [Dec 2023]
  ☆43Updated 9 months ago
• azshue / AutoPoison
  The official repository of the paper "On the Exploitability of Instruction Tuning".
  ☆58Updated 11 months ago
• lapisrocks / rpo
  Official repository for "Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks"
  ☆48Updated 5 months ago
• UCSB-NLP-Chang / ULD
  Implementation of paper 'Reversing the Forget-Retain Objectives: An Efficient LLM Unlearning Framework from Logit Difference' [NeurIPS'24…
  ☆16Updated 7 months ago
• McGill-NLP / AdversarialTriggers
  Code for "Universal Adversarial Triggers Are Not Universal."
  ☆16Updated 8 months ago
• Sizhe-Chen / StruQ
  official implementation of [USENIX Sec'25] StruQ: Defending Against Prompt Injection with Structured Queries
  ☆25Updated last month
• ethz-spylab / rlhf-poisoning
  Code for paper "Universal Jailbreak Backdoors from Poisoned Human Feedback"
  ☆46Updated 9 months ago
• aengusl / latent-adversarial-training
  ☆31Updated 4 months ago
• weichen-yu / LM-Extraction
  ☆40Updated last year
• ChenWu98 / agent-attack
  [Arxiv 2024] Dissecting Adversarial Robustness of Multimodal LM Agents
  ☆54Updated 2 weeks ago