Alternatives and similar repositories for PopupAttack

Users that are interested in PopupAttack are comparing it to the libraries listed below

• ChenWu98 / agent-attack
  [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents
  ☆123Updated 11 months ago
• sail-sg / Agent-Smith
  [ICML 2024] Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast
  ☆118Updated last year
• AI4Good24 / PsySafe
  ☆51Updated last year
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆92Updated 9 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆98Updated last year
• zhxieml / remiss-jailbreak
  ☆33Updated last year
• ChnQ / TracingLLM
  ☆30Updated last year
• thu-coai / SafeUnlearning
  Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks
  ☆32Updated last year
• OSU-NLP-Group / AgentAttack
  ☆23Updated last year
• safety-research / SHADE-Arena
  ☆21Updated 7 months ago
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆84Updated last year
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆65Updated last year
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆86Updated 8 months ago
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆71Updated 8 months ago
• DYR1 / MoGU
  Our research proposes a novel MoGU framework that improves LLMs' safety while preserving their usability.
  ☆18Updated last year
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆120Updated 9 months ago
• test-time-interaction / TTI
  ☆72Updated 8 months ago
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆184Updated last year
• Gen-Verse / CURE
  [NeurIPS 2025 Spotlight] Co-Evolving LLM Coder and Unit Tester via Reinforcement Learning
  ☆149Updated 4 months ago
• eric-ai-lab / MSSBench
  [ICLR 2025] Official codebase for the ICLR 2025 paper "Multimodal Situational Safety"
  ☆30Updated 7 months ago
• Lordog / R-Judge
  R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)
  ☆99Updated last month
• GXimingLu / IPA
  Codebase for Inference-Time Policy Adapters
  ☆25Updated 2 years ago
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆70Updated last year
• zhenyuhe00 / SWE-Swiss
  SWE-Swiss: A Multi-Task Fine-Tuning and RL Recipe for High-Performance Issue Resolution
  ☆104Updated 4 months ago
• Princeton-SysML / Jailbreak_LLM
  ☆193Updated 2 years ago
• tatsu-lab / test_set_contamination
  ☆41Updated 2 years ago
• UCSC-VLAA / AttnGCG-attack
  ☆23Updated 7 months ago
• AI45Lab / REEF
  The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…
  ☆74Updated last year
• akumar2709 / OVERTHINK_public
  ☆47Updated this week
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆151Updated last year