Alternatives and similar repositories for PopupAttack

Users that are interested in PopupAttack are comparing it to the libraries listed below

• xbmxb / EnvDistraction
  ☆19Updated 8 months ago
• OSU-NLP-Group / AgentAttack
  ☆19Updated 8 months ago
• zhxieml / remiss-jailbreak
  ☆30Updated last year
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆99Updated last month
• RobustNLP / DeRTa
  A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.
  ☆61Updated last month
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆79Updated 8 months ago
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆61Updated 5 months ago
• microsoft / SWE-bench-Live
  🚀 SWE-bench Goes Live!
  ☆80Updated this week
• ChenWu98 / agent-attack
  [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents
  ☆91Updated 4 months ago
• DYR1 / MoGU
  Our research proposes a novel MoGU framework that improves LLMs' safety while preserving their usability.
  ☆15Updated 5 months ago
• test-time-interaction / TTI
  ☆40Updated 2 weeks ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 2 months ago
• SafeAILab / RAIN
  [ICLR'24] RAIN: Your Language Models Can Align Themselves without Finetuning
  ☆94Updated last year
• amazon-science / llm-code-preference
  Training and Benchmarking LLMs for Code Preference.
  ☆33Updated 7 months ago
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆82Updated last month
• ChnQ / TracingLLM
  ☆26Updated last year
• ZhentingWang / DUMP
  ☆20Updated last month
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆76Updated last month
• princeton-nlp / benign-data-breaks-safety
  ☆41Updated 8 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆27Updated 4 months ago
• qishenghu / InstructCoder
  InstructCoder: Instruction Tuning Large Language Models for Code Editing | Oral ACL-2024 srw
  ☆63Updated 8 months ago
• tatsu-lab / test_set_contamination
  ☆37Updated last year
• crux-eval / eval-arena
  ☆26Updated this week
• facebookresearch / SecAlign
  Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"
  ☆50Updated 2 months ago
• unbiarirang / Fixed-Input-Parameterization
  This repository contains the official code for the paper: "Prompt Injection: Parameterization of Fixed Inputs"
  ☆32Updated 9 months ago
• zitian-gao / SC-MCTS
  Interpretable Contrastive Monte Carlo Tree Search Reasoning
  ☆48Updated 7 months ago
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆28Updated last year
• pillowsofwind / Course-Correction
  [EMNLP 2024] The official GitHub repo for the paper "Course-Correction: Safety Alignment Using Synthetic Preferences"
  ☆19Updated 8 months ago
• SORRY-Bench / sorry-bench
  Benchmark evaluation code for "SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal" (ICLR 2025)
  ☆55Updated 3 months ago
• OSU-NLP-Group / WebDreamer
  "Is Your LLM Secretly a World Model of the Internet? Model-Based Planning for Web Agents"
  ☆77Updated 2 months ago