Alternatives and similar repositories for PopupAttack

Users that are interested in PopupAttack are comparing it to the libraries listed below

• ChenWu98 / agent-attack
  [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents
  ☆122Updated 11 months ago
• AI4Good24 / PsySafe
  ☆51Updated 11 months ago
• ChnQ / TracingLLM
  ☆30Updated last year
• Gen-Verse / CURE
  [NeurIPS 2025 Spotlight] Co-Evolving LLM Coder and Unit Tester via Reinforcement Learning
  ☆148Updated 4 months ago
• sail-sg / Agent-Smith
  [ICML 2024] Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast
  ☆118Updated last year
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆98Updated last year
• thu-coai / SafeUnlearning
  Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks
  ☆32Updated last year
• OSU-NLP-Group / AgentAttack
  ☆23Updated last year
• AI45Lab / REEF
  The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…
  ☆74Updated last year
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆71Updated 8 months ago
• xbmxb / EnvDistraction
  ☆23Updated last year
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆179Updated last year
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆65Updated last year
• zhxieml / remiss-jailbreak
  ☆33Updated last year
• eric-ai-lab / MSSBench
  [ICLR 2025] Official codebase for the ICLR 2025 paper "Multimodal Situational Safety"
  ☆30Updated 7 months ago
• thu-coai / Agent-SafetyBench
  ☆89Updated 5 months ago
• DYR1 / MoGU
  Our research proposes a novel MoGU framework that improves LLMs' safety while preserving their usability.
  ☆18Updated last year
• pillowsofwind / Course-Correction
  [EMNLP 2024] The official GitHub repo for the paper "Course-Correction: Safety Alignment Using Synthetic Preferences"
  ☆19Updated last year
• dukeceicenter / jailbreak-reasoning-openai-o1o3-deepseek-r1
  ☆115Updated 9 months ago
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆92Updated 8 months ago
• akumar2709 / OVERTHINK_public
  ☆47Updated last week
• GXimingLu / IPA
  Codebase for Inference-Time Policy Adapters
  ☆24Updated 2 years ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆35Updated 11 months ago
• safety-research / SHADE-Arena
  ☆22Updated 7 months ago
• Lordog / R-Judge
  R-Judge: Benchmarking Safety Risk Awareness for LLM Agents (EMNLP Findings 2024)
  ☆96Updated 2 weeks ago
• yaojin17 / Unlearning_LLM
  [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"
  ☆65Updated last year
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆84Updated last year
• crux-eval / eval-arena
  ☆32Updated last week
• test-time-interaction / TTI
  ☆72Updated 7 months ago
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆85Updated 8 months ago