Alternatives and similar repositories for gpt-4-novel-apis-attacks

Users that are interested in gpt-4-novel-apis-attacks are comparing it to the libraries listed below

• AI-secure / RedCode
  [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents
  ☆55Updated last week
• yuchen814 / CodeHalu
  ☆17Updated last year
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆122Updated last year
• ryoungj / ToolEmu
  [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
  ☆172Updated last year
• allenai / wildteaming
  ☆37Updated last year
• uiuc-kang-lab / InjecAgent
  ☆93Updated last year
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆170Updated 11 months ago
• uw-nsl / SafeDecoding
  Official Repository for ACL 2024 Paper SafeDecoding: Defending against Jailbreak Attacks via Safety-Aware Decoding
  ☆149Updated last year
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆55Updated last year
• CryptoAILab / JailbreakEval
  [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆172Updated 7 months ago
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆154Updated 5 months ago
• HumanCompatibleAI / tensor-trust-data
  Dataset for the Tensor Trust project
  ☆47Updated last year
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆115Updated last year
• andyzorigin / cybench
  ☆173Updated 5 months ago
• eth-sri / SafeCoder
  ☆48Updated last year
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆165Updated 7 months ago
• RICommunity / TAP
  TAP: An automated jailbreaking method for black-box LLMs
  ☆194Updated 11 months ago
• facebookresearch / SecAlign
  Repo for the research paper "SecAlign: Defending Against Prompt Injection with Preference Optimization"
  ☆75Updated 3 months ago
• DAMO-NLP-SG / multilingual-safety-for-LLMs
  [ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
  ☆93Updated last year
• usail-hkust / JailTrickBench
  Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)
  ☆155Updated 11 months ago
• AI-secure / DecodingTrust
  A Comprehensive Assessment of Trustworthiness in GPT Models
  ☆307Updated last year
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆348Updated 3 weeks ago
• andyzoujm / breaking-llama-guard
  Code to break Llama Guard
  ☆32Updated last year
• SalesforceAIResearch / indict_code_gen
  INDICT: Code Generation with Internal Dialogues of Critiques for Both Security and Helpfulness
  ☆13Updated last week
• XuandongZhao / weak-to-strong
  [ICML 2025] Weak-to-Strong Jailbreaking on Large Language Models
  ☆89Updated 6 months ago
• centerforaisafety / wmdp
  WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…
  ☆155Updated 5 months ago
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt injection attacks and defenses
  ☆343Updated 3 weeks ago
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆61Updated last year
• Princeton-SysML / Jailbreak_LLM
  ☆188Updated last year
• Aatrox103 / SAP
  ☆46Updated last year