Alternatives and similar repositories for llm-security-challenge

Users that are interested in llm-security-challenge are comparing it to the libraries listed below

• LostOxygen / llm-confidentiality
  Whispers in the Machine: Confidentiality in Agentic Systems
  ☆41Updated last week
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆52Updated last year
• AI-secure / AgentPoison
  [NeurIPS 2024] Official implementation for "AgentPoison: Red-teaming LLM Agents via Memory or Knowledge Base Backdoor Poisoning"
  ☆181Updated 8 months ago
• leondz / lm_risk_cards
  Risks and targets for assessing LLMs & LLM vulnerabilities
  ☆33Updated last year
• XHMY / AutoDefense
  AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks
  ☆61Updated 6 months ago
• sunblaze-ucb / cybergym
  CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…
  ☆100Updated 2 months ago
• ethz-spylab / satml-llm-ctf
  Code used to run the platform for the LLM CTF colocated with SaTML 2024
  ☆28Updated last year
• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆27Updated last year
• llm-platform-security / chatgpt-plugin-eval
  LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT Plugins
  ☆29Updated last year
• AI-secure / RedCode
  [NeurIPS'24] RedCode: Risky Code Execution and Generation Benchmark for Code Agents
  ☆60Updated last month
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆100Updated 10 months ago
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆108Updated 2 weeks ago
• uiuc-kang-lab / InjecAgent
  ☆99Updated last year
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt injection attacks and defenses in LLMs
  ☆361Updated last month
• s2e-lab / SecurityEval
  Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…
  ☆83Updated 2 years ago
• agencyenterprise / PromptInject
  PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to a…
  ☆443Updated last year
• tml-epfl / llm-adaptive-attacks
  Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks [ICLR 2025]
  ☆368Updated 10 months ago
• vinusankars / BEAST
  Implementation of BEAST adversarial attack for language models (ICML 2024)
  ☆92Updated last year
• andyzoujm / breaking-llama-guard
  Code to break Llama Guard
  ☆32Updated 2 years ago
• agiresearch / ASB
  Agent Security Bench (ASB)
  ☆155Updated last month
• eth-sri / sven
  ☆124Updated last year
• chawins / pal
  PAL: Proxy-Guided Black-Box Attack on Large Language Models
  ☆55Updated last year
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆379Updated 2 weeks ago
• IBM / URET
  Universal Robustness Evaluation Toolkit (for Evasion)
  ☆32Updated 3 months ago
• tuhh-softsec / LLMSecEval
  ☆54Updated last year
• JonasGeiping / carving
  Package to optimize Adversarial Attacks against (Large) Language Models with Varied Objectives
  ☆70Updated last year
• NYU-LLM-CTF / nyuctf_agents
  The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench
  ☆110Updated last month
• microsoft / BIPIA
  A benchmark for evaluating the robustness of LLMs and defenses to indirect prompt injection attacks.
  ☆91Updated last year
• Libr-AI / OpenRedTeaming
  Papers about red teaming LLMs and Multimodal models.
  ☆157Updated 6 months ago
• CHATS-lab / persuasive_jailbreaker
  Persuasive Jailbreaker: we can persuade LLMs to jailbreak them!
  ☆341Updated 2 months ago