sunblaze-ucb / cybergymLinks
CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on real-world vulnerability analysis tasks.
☆101Updated 2 months ago
Alternatives and similar repositories for cybergym
Users that are interested in cybergym are comparing it to the libraries listed below
Sorting:
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆111Updated 2 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆131Updated last month
- ☆103Updated 3 months ago
- An autonomous LLM-agent for large-scale, repository-level code auditing☆296Updated 3 weeks ago
- ☆182Updated 2 weeks ago
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆63Updated this week
- Security Harness Engineering for Robust Program Analysis☆106Updated 4 months ago
- 🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeati…☆64Updated 4 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆384Updated 3 weeks ago
- Challenge Problem #1 - Linux Kernel (NOTE: This code does not reflect the active state of what will be used at competition time, please r…☆59Updated last year
- The automated prompt injection framework for LLM-integrated applications.☆243Updated last year
- A comprehensive local Linux Privilege-Escalation Benchmark☆44Updated last month
- ☆77Updated last month
- Buttercup CRS as submitted to the AIxCC Final Competition☆91Updated 5 months ago
- ☆66Updated 3 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆101Updated 10 months ago
- AIxCC Cyber Reasoning System (CRS) that autonomously discovers and patches security vulnerabilities☆69Updated this week
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆62Updated 7 months ago
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆91Updated 8 months ago
- ☆125Updated last year
- VulZoo: A Comprehensive Vulnerability Intelligence Dataset | ASE 2024 Demo☆66Updated 9 months ago
- [SOSP'25] Automatic checker synthesis for system-level static analysis☆153Updated 2 months ago
- ☆25Updated last year
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆332Updated last year
- ☆54Updated last year
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆112Updated last year
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆91Updated 11 months ago
- Hey folks, this is a repository for papers on LLM for Vuln. Detection area☆72Updated 8 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆82Updated 2 years ago
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆133Updated 11 months ago