sunblaze-ucb / cybergymLinks
CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on real-world vulnerability analysis tasks.
☆48Updated last week
Alternatives and similar repositories for cybergym
Users that are interested in cybergym are comparing it to the libraries listed below
Sorting:
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆89Updated last week
- An autonomous LLM-agent for large-scale, repository-level code auditing☆186Updated 2 weeks ago
- ☆120Updated last year
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆59Updated this week
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆74Updated last year
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆84Updated 6 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆69Updated 2 weeks ago
- A comprehensive local Linux Privilege-Escalation Benchmark☆37Updated 2 months ago
- Challenge Problem #1 - Linux Kernel (NOTE: This code does not reflect the active state of what will be used at competition time, please r…☆53Updated last year
- ☆26Updated last year
- ☆127Updated last month
- The automated prompt injection framework for LLM-integrated applications.☆220Updated 10 months ago
- ☆63Updated 2 months ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆57Updated 3 months ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆113Updated last year
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆85Updated 3 months ago
- This is a dataset intended to train a LLM model for a completely CVE focused input and output.☆63Updated last month
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆226Updated last week
- VulZoo: A Comprehensive Vulnerability Intelligence Dataset | ASE 2024 Demo☆57Updated 4 months ago
- ☆47Updated 10 months ago
- TensorFlow API analysis tool and malicious model detection tool☆33Updated 2 months ago
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆81Updated 6 months ago
- ☆25Updated last year
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆61Updated 4 months ago
- ☠️ Ground-truth dataset for vulnerability prediction (known research datasets and data sources included such as NVD, CVE Details and OSV)…☆93Updated last year
- The official repository of "GraphSPD: Graph-Based Security Patch Detection with Enriched Code Semantics". The paper will appear in the IE…☆46Updated last year
- CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Software☆264Updated last year
- 🪐 A Database of Existing Security Vulnerabilities Patches to Enable Evaluation of Techniques (single-commit; multi-language)☆41Updated 3 months ago
- [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…☆48Updated 4 months ago
- ☆65Updated 6 months ago