Alternatives and similar repositories for gpt-4-novel-apis-attacks

Users that are interested in gpt-4-novel-apis-attacks are comparing it to the libraries listed below

• andyzorigin / cybench
  ☆182Updated 3 weeks ago
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt injection attacks and defenses in LLMs
  ☆368Updated 2 months ago
• CryptoAILab / JailbreakEval
  [NDSS'25 Best Technical Poster] A collection of automated evaluators for assessing jailbreak attempts.
  ☆178Updated 9 months ago
• HumanCompatibleAI / tensor-trust-data
  Dataset for the Tensor Trust project
  ☆47Updated last year
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆55Updated last year
• Yu-Fangxu / COLD-Attack
  [ICML 2024] COLD-Attack: Jailbreaking LLMs with Stealthiness and Controllability
  ☆176Updated last year
• AI-secure / RedCode
  [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents
  ☆61Updated last month
• AI-secure / DecodingTrust
  A Comprehensive Assessment of Trustworthiness in GPT Models
  ☆311Updated last year
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆159Updated 7 months ago
• yuchen814 / CodeHalu
  ☆18Updated last year
• uiuc-kang-lab / InjecAgent
  ☆101Updated last year
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]
  ☆371Updated 11 months ago
• Princeton-SysML / Jailbreak_LLM
  ☆191Updated 2 years ago
• ethz-spylab / rlhf_trojan_competition
  Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.
  ☆116Updated last year
• sunblaze-ucb / cybergym
  CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…
  ☆101Updated 2 months ago
• anthropics / sleeper-agents-paper
  Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".
  ☆123Updated last year
• Aatrox103 / SAP
  ☆48Updated last year
• RICommunity / TAP
  TAP: An automated jailbreaking method for black-box LLMs
  ☆213Updated last year
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆92Updated last year
• LostOxygen / llm-confidentiality
  Whispers in the Machine: Confidentiality in Agentic Systems
  ☆41Updated 3 weeks ago
• GraySwanAI / nanoGCG
  A fast + lightweight implementation of the GCG algorithm in PyTorch
  ☆308Updated 7 months ago
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆393Updated last month
• NJUNLP / ReNeLLM
  The official implementation of our NAACL 2024 paper "A Wolf in Sheep’s Clothing: Generalized Nested Jailbreak Prompts can Fool Large Lang…
  ☆150Updated 4 months ago
• usail-hkust / JailTrickBench
  Bag of Tricks: Benchmarking of Jailbreak Attacks on LLMs. Empirical tricks for LLM Jailbreaking. (NeurIPS 2024)
  ☆157Updated last year
• allenai / wildteaming
  ☆38Updated last year
• HKUST-KnowComp / GEIA
  Code for Findings-ACL 2023 paper: Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Rec…
  ☆48Updated last year
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆182Updated 8 months ago
• CHATS-lab / persuasive_jailbreaker
  Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!
  ☆344Updated 2 months ago
• SheltonLiu-N / Universal-Prompt-Injection
  The official implementation of our pre-print paper "Automatic and Universal Prompt Injection Attacks against Large Language Models".
  ☆67Updated last year
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆53Updated last year