Alternatives and similar repositories for PopupAttack

Users that are interested in PopupAttack are comparing it to the libraries listed below

• sail-sg / Agent-Smith
  [ICML 2024] Agent Smith: A Single Image Can Jailbreak One Million Multimodal LLM Agents Exponentially Fast
  ☆114Updated last year
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆84Updated 4 months ago
• limenlp / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• ChenWu98 / agent-attack
  [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents
  ☆102Updated 7 months ago
• test-time-interaction / TTI
  ☆60Updated 3 months ago
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆165Updated last year
• Gen-Verse / CURE
  ReasonFlux-Coder: Open-Source LLM Coders with Co-Evolving Reinforcement Learning
  ☆115Updated 3 weeks ago
• safety-research / SHADE-Arena
  ☆19Updated 3 months ago
• xbmxb / EnvDistraction
  ☆22Updated 11 months ago
• AI4Good24 / PsySafe
  ☆48Updated 7 months ago
• ChnQ / TracingLLM
  ☆30Updated last year
• ZhentingWang / DUMP
  ☆26Updated 4 months ago
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆82Updated 10 months ago
• OSU-NLP-Group / AgentAttack
  ☆22Updated 10 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆111Updated 4 months ago
• JHU-CLSP / turking-bench
  Web-grounded natural language instructions
  ☆17Updated 9 months ago
• GXimingLu / IPA
  Codebase for Inference-Time Policy Adapters
  ☆24Updated last year
• zhxieml / remiss-jailbreak
  ☆32Updated last year
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆59Updated 11 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆29Updated 7 months ago
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆85Updated 4 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆97Updated last year
• crux-eval / eval-arena
  ☆28Updated 2 weeks ago
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆29Updated 4 months ago
• DYR1 / MoGU
  Our research proposes a novel MoGU framework that improves LLMs' safety while preserving their usability.
  ☆16Updated 8 months ago
• MIT-MI / MEM1
  ☆108Updated last month
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 7 months ago
• Berkeley-NLP / Agent-Eval-Refine
  Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]
  ☆143Updated 9 months ago
• thu-coai / SafeUnlearning
  Safe Unlearning: A Surprisingly Effective and Generalizable Solution to Defend Against Jailbreak Attacks
  ☆31Updated last year
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆65Updated 4 months ago