lancopku / agent-backdoor-attacks

Related projects ⓘ

Alternatives and complementary repositories for agent-backdoor-attacks

• Django-Jiang / BadChain
  Official Repo of ICLR 24 BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models
  ☆17Updated 4 months ago
• papersPapers / BadPrompt
  Code for the paper "BadPrompt: Backdoor Attacks on Continuous Prompts"
  ☆36Updated 4 months ago
• byerose / Awesome-Foundation-Model-Security
  A curated list of trustworthy Generative AI papers. Daily updating...
  ☆67Updated 2 months ago
• renqibing / ActorAttack
  ☆54Updated 3 weeks ago
• YihanWang617 / llm-jailbreaking-defense
  A lightweight library for large laguage model (LLM) jailbreaking defense.
  ☆39Updated last month
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆48Updated 3 months ago
• aounon / certified-llm-safety
  ☆26Updated 3 months ago
• chujiezheng / LLM-Safeguard
  Official repository for ICML 2024 paper "On Prompt-Driven Safeguarding for Large Language Models"
  ☆73Updated 2 months ago
• ThuCCSLab / JailbreakEval
  A collection of automated evaluators for assessing jailbreak attempts.
  ☆75Updated 4 months ago
• isXinLiu / MM-SafetyBench
  Accepted by ECCV 2024
  ☆74Updated last month
• lapisrocks / rpo
  Official repository for "Robust Prompt Optimization for Defending Language Models Against Jailbreaking Attacks"
  ☆43Updated 3 months ago
• wang2226 / Trojan-Activation-Attack
  [CIKM 2024] Trojan Activation Attack: Attack Large Language Models using Activation Steering for Safety-Alignment.
  ☆19Updated 3 months ago
• vinid / safety-tuned-llamas
  ICLR2024 Paper. Showing properties of safety tuning and exaggerated safety.
  ☆71Updated 6 months ago
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆34Updated last month
• HKUST-KnowComp / LLM-Multistep-Jailbreak
  Code for Findings-EMNLP 2023 paper: Multi-step Jailbreaking Privacy Attacks on ChatGPT
  ☆25Updated last year
• renqibing / CodeAttack
  [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion
  ☆29Updated 3 weeks ago
• ThuCCSLab / FigStep
  Jailbreaking Large Vision-language Models via Typographic Visual Prompts
  ☆87Updated 6 months ago
• CLAS2024 / starter-kit
  ☆34Updated 2 weeks ago
• wegodev2 / virtual-prompt-injection
  Unofficial implementation of "Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection"
  ☆14Updated 4 months ago
• git-disl / awesome_LLM-harmful-fine-tuning-papers
  A survey on harmful fine-tuning attack for large language model
  ☆80Updated this week
• facebookresearch / advprompter
  Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873
  ☆122Updated 6 months ago
• kztakemoto / simbaja
  All in How You Ask for It: Simple Black-Box Method for Jailbreak Attacks
  ☆15Updated 7 months ago
• BHui97 / PLeak
  ☆39Updated 9 months ago
• bboylyg / BackdoorLLM
  BackdoorLLM: A Comprehensive Benchmark for Backdoor Attacks on Large Language Models
  ☆74Updated 2 months ago
• rotaryhammer / code-autodan
  An unofficial implementation of AutoDAN attack on LLMs (arXiv:2310.15140)
  ☆30Updated 9 months ago
• GodXuxilie / PromptAttack
  An LLM can Fool Itself: A Prompt-Based Adversarial Attack (ICLR 2024)
  ☆56Updated 4 months ago
• Vaidehi99 / InfoDeletionAttacks
  ☆38Updated last year
• niconi19 / LLM-Conversation-Safety
  [NAACL2024] Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey
  ☆76Updated 3 months ago
• git-disl / Vaccine
  This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)
  ☆19Updated this week
• pasquini-dario / LLM_NeuralExec
  Code to generate NeuralExecs (prompt injection for LLMs)
  ☆17Updated 3 months ago