microsoft / BIPIA

Related projects ⓘ

Alternatives and complementary repositories for BIPIA

• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆32Updated 2 weeks ago
• uiuc-kang-lab / InjecAgent
  ☆37Updated 4 months ago
• ebagdasa / multimodal_injection
  ☆72Updated last year
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆96Updated 3 months ago
• liu00222 / Open-Prompt-Injection
  This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
  ☆141Updated 2 months ago
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆58Updated this week
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆72Updated 5 months ago
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆77Updated 3 weeks ago
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆46Updated 2 months ago
• RICommunity / TAP
  TAP: An automated jailbreaking method for black-box LLMs
  ☆117Updated 8 months ago
• ThuCCSLab / JailbreakEval
  A collection of automated evaluators for assessing jailbreak attempts.
  ☆71Updated 4 months ago
• facebookresearch / SecAlign
  Repo for the research paper "Aligning LLMs to Be Robust Against Prompt Injection"
  ☆18Updated last week
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆104Updated last month
• BHui97 / PLeak
  ☆35Updated 9 months ago
• JailbreakBench / jailbreakbench
  JailbreakBench: An Open Robustness Benchmark for Jailbreaking Language Models [NeurIPS 2024 Datasets and Benchmarks Track]
  ☆225Updated last month
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆63Updated 8 months ago
• poloclub / llm-self-defense
  LLM Self Defense: By Self Examination, LLMs know they are being tricked
  ☆26Updated 5 months ago
• BillChan226 / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆55Updated 3 months ago
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆211Updated last month
• facebookresearch / advprompter
  Official implementation of AdvPrompter https//arxiv.org/abs/2404.16873
  ☆120Updated 6 months ago
• sleeepeer / PoisonedRAG
  [USENIX Security 2025] PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models
  ☆90Updated 3 weeks ago
• ThuCCSLab / FigStep
  Jailbreaking Large Vision-language Models via Typographic Visual Prompts
  ☆85Updated 6 months ago
• llm-platform-security / SecGPT
  SecGPT: An execution isolation architecture for LLM-based systems
  ☆47Updated last week
• verazuo / prompt-stealing-attack
  [USENIX'24] Prompt Stealing Attacks Against Text-to-Image Generation Models
  ☆22Updated last month
• haizelabs / redteaming-resistance-benchmark
  ☆33Updated 3 months ago
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆107Updated 4 months ago
• centerforaisafety / wmdp
  WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…
  ☆78Updated 6 months ago
• iamgroot42 / mimir
  Python package for measuring memorization in LLMs.
  ☆118Updated last month
• rotaryhammer / code-autodan
  An unofficial implementation of AutoDAN attack on LLMs (arXiv:2310.15140)
  ☆29Updated 9 months ago
• declare-lab / red-instruct
  Codes and datasets of the paper Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignment
  ☆78Updated 8 months ago