sunblaze-ucb / cybergymLinks
CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on real-world vulnerability analysis tasks.
☆98Updated last month
Alternatives and similar repositories for cybergym
Users that are interested in cybergym are comparing it to the libraries listed below
Sorting:
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆107Updated last month
- An autonomous LLM-agent for large-scale, repository-level code auditing☆282Updated this week
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆124Updated 3 weeks ago
- 🥇 Amazon Nova AI Challenge Winner - ASTRA emerged victorious as the top attacking team in Amazon's global AI safety competition, defeati…☆63Updated 3 months ago
- ☆98Updated 2 months ago
- Security Harness Engineering for Robust Program Analysis☆104Updated 3 months ago
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆61Updated last week
- ☆178Updated 5 months ago
- ☆124Updated last year
- The automated prompt injection framework for LLM-integrated applications.☆241Updated last year
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆100Updated 10 months ago
- All about llm-agents security,attack,vulnerabilities and how to do them for cybersecurity.☆37Updated 10 months ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆64Updated 7 months ago
- Buttercup CRS as submitted to the AIxCC Final Competition☆89Updated 4 months ago
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆87Updated 10 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆82Updated 2 years ago
- ☆25Updated last year
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆92Updated 7 months ago
- Challenge Problem #1 - Linux Kernel (NOTE: This code does not reflect the active state of what will be used at competition time, please r…☆59Updated last year
- VulZoo: A Comprehensive Vulnerability Intelligence Dataset | ASE 2024 Demo☆65Updated 8 months ago
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆130Updated 10 months ago
- ☆54Updated last year
- AIxCC Cyber Reasoning System (CRS) that autonomously discovers and patches security vulnerabilities☆62Updated this week
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆328Updated last year
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆362Updated last month
- [SOSP'25] Automatic checker synthesis for system-level static analysis☆147Updated last month
- This is a dataset intended to train a LLM model for a completely CVE focused input and output.☆65Updated 5 months ago
- ☆65Updated 2 months ago
- ☆36Updated 5 months ago
- CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Software☆308Updated last year