Alternatives and similar repositories for PopupAttack

Users that are interested in PopupAttack are comparing it to the libraries listed below

• sail-sg / Agent-Smith
  [ICML 2024] Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast
  ☆118Updated last year
• Gen-Verse / CURE
  [NeurIPS 2025 Spotlight] Co-Evolving LLM Coder and Unit Tester via Reinforcement Learning
  ☆150Updated 4 months ago
• ChenWu98 / agent-attack
  [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents
  ☆123Updated 11 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆98Updated last year
• ChnQ / TracingLLM
  ☆30Updated last year
• test-time-interaction / TTI
  ☆72Updated 7 months ago
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆85Updated 8 months ago
• thu-coai / SafeUnlearning
  Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks
  ☆32Updated last year
• zhxieml / remiss-jailbreak
  ☆33Updated last year
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆84Updated last year
• AI45Lab / REEF
  The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…
  ☆74Updated last year
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆65Updated last year
• AI4Good24 / PsySafe
  ☆51Updated 11 months ago
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆92Updated 9 months ago
• eric-ai-lab / MSSBench
  [ICLR 2025] Official codebase for the ICLR 2025 paper "Multimodal Situational Safety"
  ☆30Updated 7 months ago
• DYR1 / MoGU
  Our research proposes a novel MoGU framework that improves LLMs' safety while preserving their usability.
  ☆18Updated last year
• OSU-NLP-Group / AgentAttack
  ☆23Updated last year
• xbmxb / EnvDistraction
  ☆23Updated last year
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆36Updated 11 months ago
• GXimingLu / IPA
  Codebase for Inference-Time Policy Adapters
  ☆25Updated 2 years ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆51Updated 6 months ago
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆183Updated last year
• LAMDASZ-ML / Self-Backtracking
  ☆50Updated 11 months ago
• safety-research / SHADE-Arena
  ☆22Updated 7 months ago
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆71Updated 8 months ago
• T1aNS1R / Evil-Geniuses
  ☆70Updated 2 years ago
• lukahhcm / Awesome_Environment_Scaling
  Resources and paper list for 'Scaling Environments for Agents'. This repository accompanies our survey on how environments contribute to …
  ☆58Updated last week
• sail-sg / MMCBench
  ☆27Updated 2 years ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆120Updated 9 months ago
• ZHZisZZ / weak-to-strong-search
  [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models
  ☆65Updated last year