controllability / jailbreak-evaluation

Related projects ⓘ

Alternatives and complementary repositories for jailbreak-evaluation

• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆46Updated 3 months ago
• RapidResponseBench / rapidresponsebench
  ☆17Updated last week
• Babelscape / ALERT
  Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"
  ☆33Updated 2 months ago
• Valhall-ai / prompt-injection-mitigations
  A collection of prompt injection mitigation techniques.
  ☆18Updated last year
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆73Updated 6 months ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆41Updated last month
• azshue / AutoPoison
  The official repository of the paper "On the Exploitability of Instruction Tuning".
  ☆57Updated 9 months ago
• OSU-NLP-Group / SELM
  Symmetric Encryption with Language Models
  ☆11Updated last year
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆34Updated 3 weeks ago
• liu00222 / Open-Prompt-Injection
  This repository provides implementation to formalize and benchmark Prompt Injection attacks and defenses
  ☆146Updated 2 months ago
• NickNameInvalid / LLM_CTF
  ☆62Updated last month
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆110Updated 2 months ago
• AlignmentResearch / gpt-4-novel-apis-attacks
  ☆17Updated 10 months ago
• xirui-li / DrAttack
  Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers
  ☆36Updated 2 months ago
• wagner-group / prompt-injection-defense
  Fine-tuning base models to build robust task-specific models
  ☆24Updated 7 months ago
• XuandongZhao / weak-to-strong
  Weak-to-Strong Jailbreaking on Large Language Models
  ☆67Updated 9 months ago
• NYU-LLM-CTF / llm_ctf_automation
  ☆36Updated this week
• tpai / gandalf-prompt-injection-writeup
  A writeup for the Gandalf prompt injection game.
  ☆36Updated last year
• uiuc-kang-lab / InjecAgent
  ☆39Updated 4 months ago
• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆47Updated 7 months ago
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆52Updated last month
• dreadnode / research
  General research for Dreadnode
  ☆17Updated 5 months ago
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆64Updated 9 months ago
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆26Updated this week
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [arXiv, Apr 2024]
  ☆220Updated 2 months ago
• Aatrox103 / SAP
  ☆40Updated 6 months ago
• ThuCCSLab / JailbreakEval
  A collection of automated evaluators for assessing jailbreak attempts.
  ☆75Updated 4 months ago
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆78Updated this week
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆62Updated 8 months ago
• andyzorigin / cybench
  ☆63Updated this week