sunblaze-ucb / cybergymLinks
CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on real-world vulnerability analysis tasks.
☆90Updated last month
Alternatives and similar repositories for cybergym
Users that are interested in cybergym are comparing it to the libraries listed below
Sorting:
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆102Updated 3 weeks ago
- An autonomous LLM-agent for large-scale, repository-level code auditing☆268Updated this week
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆113Updated this week
- ☆168Updated 5 months ago
- ☆95Updated last month
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆60Updated last week
- Security Harness Engineering for Robust Program Analysis☆102Updated 2 months ago
- 🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeati…☆62Updated 3 months ago
- ☆25Updated last year
- Challenge Problem #1 - Linux Kernel (NOTE: This code does not reflect the active state of what will be used at competition time, please r…☆58Updated last year
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆90Updated 6 months ago
- VulZoo: A Comprehensive Vulnerability Intelligence Dataset | ASE 2024 Demo☆65Updated 7 months ago
- ☆124Updated last year
- The automated prompt injection framework for LLM-integrated applications.☆236Updated last year
- ☆65Updated 2 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆98Updated 9 months ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆63Updated 6 months ago
- A comprehensive local Linux Privilege-Escalation Benchmark☆43Updated last week
- Buttercup CRS as submitted to the AIxCC Final Competition☆88Updated 4 months ago
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆128Updated 10 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆80Updated 2 years ago
- Cyber Reasoning System (CRS) that autonomously discovered 28 security vulnerabilities—including six previously unknown zero-days—in real-…☆57Updated last week
- ☆52Updated last year
- ☆75Updated last week
- The official repository of "GraphSPD: Graph-Based Security Patch Detection with Enriched Code Semantics". The paper will appear in the IE…☆48Updated 2 years ago
- [SOSP'25] Automatic checker synthesis for system-level static analysis☆138Updated 3 weeks ago
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆87Updated 9 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆343Updated 2 weeks ago
- ☆36Updated 4 months ago
- Hey folks, this is a repository for papers on LLM for Vuln. Detection area☆69Updated 7 months ago