Alternatives and similar repositories for cybergym

Users that are interested in cybergym are comparing it to the libraries listed below

• NYU-LLM-CTF / nyuctf_agents
  The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench
  ☆86Updated last week
• PurCL / RepoAudit
  An autonomous LLM-agent for large-scale, repository-level code auditing
  ☆159Updated last week
• timothee-chauvin / eyeballvul
  future-proof vulnerability detection benchmark, based on CVEs in open-source repos
  ☆58Updated this week
• andyzorigin / cybench
  ☆121Updated last month
• uiuc-kang-lab / cve-bench
  CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities
  ☆62Updated 3 weeks ago
• llm-platform-security / SecGPT
  An Execution Isolation Architecture for LLM-Based Agentic Systems
  ☆83Updated 5 months ago
• s2e-lab / SecurityEval
  Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…
  ☆72Updated last year
• lve-org / lve
  A repository of Language Model Vulnerabilities and Exposures (LVEs).
  ☆112Updated last year
• eth-sri / sven
  ☆119Updated last year
• ethz-spylab / agentdojo
  A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.
  ☆202Updated last week
• tuhh-softsec / LLMSecEval
  ☆45Updated 9 months ago
• mnns / LLMFuzzer
  🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …
  ☆286Updated last year
• niklasrisse / LimitsOfML4Vuln
  ☆26Updated last year
• NickNameInvalid / LLM_CTF
  ☆65Updated 5 months ago
• datasec-lab / CodeBreaker
  [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…
  ☆47Updated 3 months ago
• hupe1980 / aisploit
  🤖🛡️🔍🔒🔑 Tiny package designed to support red teams and penetration testers in exploiting large language model AI solutions.
  ☆23Updated last year
• NUS-Curiosity / VulZoo
  VulZoo: A Comprehensive Vulnerability Intelligence Dataset (ASE 2024 Demo)
  ☆54Updated 3 months ago
• NYU-LLM-CTF / NYU_CTF_Bench
  ☆59Updated 2 months ago
• uiuc-kang-lab / InjecAgent
  ☆67Updated last year
• liu00222 / Open-Prompt-Injection
  This repository provides a benchmark for prompt Injection attacks and defenses
  ☆245Updated last month
• ipa-lab / benchmark-privesc-linux
  A comprehensive local Linux Privilege-Escalation Benchmark
  ☆37Updated last month
• LLMSecurity / HouYi
  The automated prompt injection framework for LLM-integrated applications.
  ☆216Updated 10 months ago
• pasquini-dario / LLMmap
  ☆48Updated 9 months ago
• NASP-THU / ProphetFuzz
  [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.
  ☆84Updated 2 months ago
• TQRG / secbench
  🪐 A Database of Existing Security Vulnerabilities Patches to Enable Evaluation of Techniques (single-commit; multi-language)
  ☆40Updated 3 months ago
• briland / LLM-security-and-privacy
  LLM security and privacy
  ☆48Updated 9 months ago
• ai4cloudops / SecLLMHolmes
  SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…
  ☆58Updated 2 months ago
• ShenaoW / awesome-llm-supply-chain-security
  A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)
  ☆78Updated 5 months ago
• AIM-Intelligence / Automated-Multi-Turn-Jailbreaks
  ☆75Updated 7 months ago
• aixcc-public / challenge-001-exemplar
  Challenge Problem #1 - Linux Kernel (NOTE: This code does not reflect the active state of what will be used at competition time, please r…
  ☆53Updated last year