weizeming / momentum-attack-llm

Related projects: ⓘ

• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆27Updated 5 months ago
• McGill-NLP / AdversarialTriggers
  Code for "Universal Adversarial Triggers Are Not Universal."
  ☆15Updated 4 months ago
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NextGenAISafety @ ICML 2024)
  ☆37Updated last month
• zhaoyiran924 / Probe-Sampling
  Code of paper "Accelerating Greedy Coordinate Gradient via Probe Sampling"
  ☆16Updated 5 months ago
• weichen-yu / LM-Extraction
  ☆38Updated last year
• TrustAIRLab / VoiceJailbreakAttack
  Code for Voice Jailbreak Attacks Against GPT-4o.
  ☆20Updated 3 months ago
• azshue / AutoPoison
  The official repository of the paper "On the Exploitability of Instruction Tuning".
  ☆56Updated 7 months ago
• pratyushmaini / llm_dataset_inference
  Official Repository for Dataset Inference for LLMs
  ☆21Updated last month
• OSU-NLP-Group / AmpleGCG
  AmpleGCG: Learning a Universal and Transferable Generator of Adversarial Attacks on Both Open and Closed LLM
  ☆33Updated 3 weeks ago
• ChenWu98 / agent-attack
  [Arxiv 2024] Adversarial attacks on multimodal agents
  ☆33Updated 2 months ago
• Unispac / shallow-vs-deep-alignment
  Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  ☆22Updated 2 months ago
• ejones313 / auditing-llms
  ☆47Updated last year
• licong-lin / negative-preference-optimization
  ☆21Updated 2 months ago
• locuslab / acr-memorization
  ☆23Updated 4 months ago
• thestephencasper / explore_establish_exploit_llms
  ☆30Updated last year
• yjw1029 / Self-Reminder
  Code for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder" in NMI.
  ☆40Updated 10 months ago
• jiaxiaojunQAQ / I-GCG
  Improved techniques for optimization-based jailbreaking on large language models
  ☆33Updated 3 months ago
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆45Updated last month
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆59Updated 6 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆37Updated 10 months ago
• sail-sg / AnyDoor
  AnyDoor: Test-Time Backdoor Attacks on Multimodal Large Language Models
  ☆39Updated 5 months ago
• kztakemoto / simbaja
  All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks
  ☆11Updated 4 months ago
• BillChan226 / AgentPoison
  Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆36Updated last month
• arobey1 / advbench
  ☆34Updated last year
• princeton-nlp / benign-data-breaks-safety
  ☆12Updated 3 months ago
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆20Updated 4 months ago
• yjw1029 / Self-Reminder-Data
  Data for our paper "Defending ChatGPT against Jailbreak Attack via Self-Reminder"
  ☆17Updated 10 months ago
• git-disl / Vaccine
  This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models"
  ☆12Updated last week
• papersPapers / BadPrompt
  Code for the paper "BadPrompt: Backdoor Attacks on Continuous Prompts"
  ☆32Updated 2 months ago
• chiayi-hsu / Ring-A-Bell
  ☆14Updated 3 weeks ago