Alternatives and similar repositories for gpt-4-novel-apis-attacks

Users that are interested in gpt-4-novel-apis-attacks are comparing it to the libraries listed below

• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆176Updated last year
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆159Updated 8 months ago
• CryptoAILab / JailbreakEval
  [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆184Updated 10 months ago
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt injection attacks and defenses in LLMs
  ☆381Updated 3 months ago
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]
  ☆377Updated last year
• AI-secure / RedCode
  [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents
  ☆64Updated 2 months ago
• RICommunity / TAP
  TAP: An automated jailbreaking method for black-box LLMs
  ☆217Updated last year
• Aatrox103 / SAP
  ☆48Updated last year
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆92Updated last year
• NJUNLP / ReNeLLM
  The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…
  ☆152Updated 4 months ago
• xirui-li / DrAttack
  Official implementation of paper: DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers
  ☆66Updated last year
• CHATS-lab / persuasive_jailbreaker
  Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!
  ☆350Updated 3 months ago
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆193Updated 9 months ago
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆420Updated 2 months ago
• Princeton-SysML / Jailbreak_LLM
  ☆192Updated 2 years ago
• AI-secure / DecodingTrust
  A Comprehensive Assessment of Trustworthiness in GPT Models
  ☆310Updated last year
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆57Updated last year
• uiuc-kang-lab / InjecAgent
  ☆112Updated last year
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆153Updated last year
• usail-hkust / JailTrickBench
  Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)
  ☆160Updated last year
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆113Updated last month
• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆98Updated last year
• andyzorigin / cybench
  ☆188Updated last month
• LostOxygen / llm-confidentiality
  Whispers in the Machine: Confidentiality in Agentic Systems
  ☆41Updated last month
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆68Updated last year
• LLM-Tuning-Safety / LLMs-Finetuning-Safety
  We jailbreak GPT-3.5 Turbo’s safety guardrails by fine-tuning it on only 10 adversarially designed examples, at a cost of less than $0.20…
  ☆336Updated last year
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆97Updated last year
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆53Updated last year
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆116Updated last year
• HumanCompatibleAI / tensor-trust-data
  Dataset for the Tensor Trust project
  ☆47Updated last year