Alternatives and similar repositories for CyberBench

Users that are interested in CyberBench are comparing it to the libraries listed below

• pasquini-dario / LLMmap
  ☆77Updated 3 months ago
• sunblaze-ucb / cybergym
  CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…
  ☆84Updated 3 weeks ago
• NYU-LLM-CTF / NYU_CTF_Bench
  ☆94Updated last month
• xashru / cti-bench
  ☆66Updated last year
• PalisadeResearch / intercode
  https://arxiv.org/abs/2412.02776
  ☆64Updated 10 months ago
• morpheuslord / CVE-llm_dataset
  This is a dataset intended to train a LLM model for a completely CVE focused input and output.
  ☆63Updated 4 months ago
• NickNameInvalid / LLM_CTF
  ☆65Updated last month
• andreashappe / cochise
  Autonomous Assumed Breach Penetration-Testing Active Directory Networks
  ☆26Updated this week
• NYU-LLM-CTF / nyuctf_agents
  The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench
  ☆99Updated last week
• xsankar / AI-Red-Teaming
  All things specific to LLM Red Teaming Generative AI
  ☆29Updated last year
• 5stars217 / malicious_models
  using ML models for red teaming
  ☆44Updated 2 years ago
• dreadnode / parley
  Tree of Attacks (TAP) Jailbreaking Implementation
  ☆114Updated last year
• AI-in-Complex-Systems-Lab / LLM-Honeypot
  LLM Honeypot: Leveraging Large Language Models as Advanced Interactive Honeypot Systems
  ☆24Updated 7 months ago
• Valhall-ai / prompt-injection-mitigations
  A collection of prompt injection mitigation techniques.
  ☆24Updated 2 years ago
• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆27Updated last year
• mitre-atlas / atlas-data
  ATLAS tactics, techniques, and case studies data
  ☆85Updated 2 weeks ago
• BishopFox / BrokenHill
  A productionized greedy coordinate gradient (GCG) attack tool for large language models (LLMs)
  ☆142Updated 10 months ago
• cysecbench / dataset
  Generative AI-based CyberSecurity-focused Prompt Dataset for Benchmarking Large Language Models
  ☆25Updated 9 months ago
• parameterlab / trap
  Source code of "TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identification", ACL2024 (findings)
  ☆13Updated 11 months ago
• CS-EVAL / CS-Eval
  CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.
  ☆54Updated 11 months ago
• andyzorigin / cybench
  ☆165Updated 4 months ago
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆97Updated 9 months ago
• NVISOsecurity / cyber-security-llm-agents
  A collection of agents that use Large Language Models (LLMs) to perform tasks common on our day to day jobs in cyber security.
  ☆198Updated last year
• trailofbits / afc-buttercup
  Buttercup CRS as submitted to the AIxCC Final Competition
  ☆84Updated 3 months ago
• invariantlabs-ai / mcp-injection-experiments
  Code snippets to reproduce MCP tool poisoning attacks.
  ☆183Updated 6 months ago
• wearetyomsmnv / Awesome-LLM-agent-Security
  All about llm-agents security,attack,vulnerabilities and how to do them for cybersecurity.
  ☆31Updated 9 months ago
• uiuc-kang-lab / cve-bench
  CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities
  ☆106Updated this week
• ehsanaghaei / SecureBERT-plus
  An extended version of SecureBERT, trained on top of both base and large version of RoBERTa using 10 GB cybersecurity-related data
  ☆30Updated last year
• stratosphereips / shelLM
  Code for shelLM tool
  ☆56Updated 9 months ago
• NUS-Curiosity / VulZoo
  VulZoo: A Comprehensive Vulnerability Intelligence Dataset | ASE 2024 Demo
  ☆65Updated 7 months ago