sunblaze-ucb / cybergymLinks
CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on real-world vulnerability analysis tasks.
☆101Updated this week
Alternatives and similar repositories for cybergym
Users that are interested in cybergym are comparing it to the libraries listed below
Sorting:
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆116Updated 2 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆136Updated this week
- An autonomous LLM-agent for large-scale, repository-level code auditing☆314Updated last month
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆64Updated last week
- ☆184Updated last month
- ☆113Updated 3 months ago
- 🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeati…☆68Updated 5 months ago
- Security Harness Engineering for Robust Program Analysis☆107Updated 4 months ago
- Challenge Problem #1 - Linux Kernel (NOTE: This code does not reflect the active state of what will be used at competition time, please r…☆59Updated last year
- VulZoo: A Comprehensive Vulnerability Intelligence Dataset | ASE 2024 Demo☆66Updated 9 months ago
- AIxCC Cyber Reasoning System (CRS) that autonomously discovers and patches security vulnerabilities☆74Updated this week
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆63Updated 8 months ago
- ☆126Updated last year
- ☆25Updated last year
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆93Updated 9 months ago
- Buttercup CRS as submitted to the AIxCC Final Competition☆93Updated 6 months ago
- [SOSP'25] Automatic checker synthesis for system-level static analysis☆157Updated 2 months ago
- ☆66Updated 4 months ago
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆91Updated 11 months ago
- The automated prompt injection framework for LLM-integrated applications.☆247Updated last year
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆406Updated last month
- ☆38Updated 6 months ago
- A comprehensive local Linux Privilege-Escalation Benchmark☆44Updated 2 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆101Updated 11 months ago
- ☆79Updated 2 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆82Updated 2 years ago
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆59Updated 2 months ago
- ☆55Updated last year
- ☆155Updated 4 months ago
- All about llm-agents security,attack,vulnerabilities and how to do them for cybersecurity.☆39Updated 2 weeks ago