Alternatives and similar repositories for OVERTHINK_public

Users that are interested in OVERTHINK_public are comparing it to the libraries listed below

• AI45Lab / CodeAttack
  [ACL 2024] CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completion
  ☆55Updated 2 months ago
• zihao-ai / unthinking_vulnerability
  To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
  ☆32Updated 6 months ago
• AI45Lab / ActorAttack
  ☆112Updated 10 months ago
• ChenWu98 / agent-attack
  [ICLR 2025] Dissecting adversarial robustness of multimodal language model agents
  ☆121Updated 9 months ago
• Alibaba-AAIG / Oyster
  The Oyster series is a set of safety models developed in-house by Alibaba-AAIG, devoted to building a responsible AI ecosystem. | Oyster …
  ☆57Updated 2 months ago
• lancopku / agent-backdoor-attacks
  Code&Data for the paper "Watch Out for Your Agents! Investigating Backdoor Threats to LLM-Based Agents" [NeurIPS 2024]
  ☆102Updated last year
• thunxxx / MLLM-Jailbreak-evaluation-MMJ-Bench
  ☆65Updated 8 months ago
• ShiJiawenwen / JudgeDeceiver
  [CCS 2024] Optimization-based Prompt Injection Attack to LLM-as-a-Judge
  ☆36Updated 2 months ago
• WangCheng0116 / Awesome-LRMs-Safety
  Official repository for "Safety in Large Reasoning Models: A Survey" - Exploring safety risks, attacks, and defenses for Large Reasoning …
  ☆82Updated 3 months ago
• thu-ml / STAIR
  Official codebase for "STAIR: Improving Safety Alignment with Introspective Reasoning"
  ☆87Updated 9 months ago
• sail-sg / I-FSJ
  Improved Few-Shot Jailbreaking Can Circumvent Aligned Language Models and Their Defenses (NeurIPS 2024)
  ☆65Updated 10 months ago
• wonderNefelibata / Awesome-LRM-Safety
  Awesome Large Reasoning Model(LRM) Safety.This repository is used to collect security-related research on large reasoning models such as …
  ☆78Updated this week
• Unispac / shallow-vs-deep-alignment
  Official Repository for The Paper: Safety Alignment Should Be Made More Than Just a Few Tokens Deep
  ☆166Updated 7 months ago
• NY1024 / BAP-Jailbreak-Vision-Language-Models-via-Bi-Modal-Adversarial-Prompt
  ☆52Updated last year
• SproutNan / AI-Safety_SCAV
  This is the code repository for "Uncovering Safety Risks of Large Language Models through Concept Activation Vector"
  ☆46Updated last month
• yuplin2333 / representation-space-jailbreak
  Code repo of our paper Towards Understanding Jailbreak Attacks in LLMs: A Representation Space Analysis (https://arxiv.org/abs/2406.10794…
  ☆22Updated last year
• chen37058 / Red-Team-Arxiv-Paper-Update
  Awesome Jailbreak, red teaming arxiv papers (Automatically Update Every 12th hours)
  ☆80Updated this week
• rain152 / PAT
  [NeurIPS 2024] Fight Back Against Jailbreaking via Prompt Adversarial Tuning
  ☆10Updated last year
• SaFoLab-WISC / AGrail4Agent
  [ACL 2025] The official code for "AGrail: A Lifelong Agent Guardrail with Effective and Adaptive Safety Detection".
  ☆30Updated 4 months ago
• SaFoLab-WISC / JailBreakV_28K
  [COLM 2024] JailBreakV-28K: A comprehensive benchmark designed to evaluate the transferability of LLM jailbreak attacks to MLLMs, and fur…
  ☆82Updated 7 months ago
• Jayfeather1024 / Backdoor-Enhanced-Alignment
  ☆24Updated last year
• OSU-NLP-Group / EIA_against_webagent
  ☆36Updated last year
• AI-secure / AdvAgent
  ☆18Updated 6 months ago
• Beijing-AISI / panda-guard
  Panda Guard is designed for researching jailbreak attacks, defenses, and evaluation algorithms for large language models (LLMs).
  ☆56Updated last month
• tmllab / 2025_ICLR_PiF
  ☆37Updated 6 months ago
• Django-Jiang / BadChain
  [ICLR24] Official Repo of BadChain: Backdoor Chain-of-Thought Prompting for Large Language Models
  ☆43Updated last year
• CryptoAILab / MergeGuard
  [CCS-LAMPS'24] LLM IP Protection Against Model Merging
  ☆16Updated last year
• CryptoAILab / FigStep
  [AAAI'25 (Oral)] Jailbreaking Large Vision-language Models via Typographic Visual Prompts
  ☆181Updated 5 months ago
• xyq7 / GradSafe
  Official Code for ACL 2024 paper "GradSafe: Detecting Unsafe Prompts for LLMs via Safety-Critical Gradient Analysis"
  ☆60Updated last year
• weizeming / momentum-attack-llm
  ☆23Updated 10 months ago