sunblaze-ucb / cybergymLinks
CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on real-world vulnerability analysis tasks.
☆52Updated 3 weeks ago
Alternatives and similar repositories for cybergym
Users that are interested in cybergym are comparing it to the libraries listed below
Sorting:
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆93Updated 3 weeks ago
- An autonomous LLM-agent for large-scale, repository-level code auditing☆215Updated last month
- ☆121Updated last year
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆75Updated last year
- future-proof vulnerability detection benchmark, based on CVEs in open-source repos☆59Updated this week
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆89Updated 6 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆78Updated last month
- ☆72Updated 3 months ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆57Updated 3 months ago
- ☆142Updated 2 months ago
- ☆47Updated 10 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆239Updated 2 weeks ago
- The automated prompt injection framework for LLM-integrated applications.☆221Updated 11 months ago
- Challenge Problem #1 - Linux Kernel (NOTE: This code does not reflect the active state of what will be used at competition time, please r…☆54Updated last year
- ☆26Updated last year
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆87Updated 4 months ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆307Updated last year
- TaskTracker is an approach to detecting task drift in Large Language Models (LLMs) by analysing their internal activations. It provides a…☆64Updated 2 weeks ago
- A repository of Language Model Vulnerabilities and Exposures (LVEs).☆113Updated last year
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆153Updated 10 months ago
- VulZoo: A Comprehensive Vulnerability Intelligence Dataset | ASE 2024 Demo☆58Updated 5 months ago
- 🪐 A Database of Existing Security Vulnerabilities Patches to Enable Evaluation of Techniques (single-commit; multi-language)☆41Updated 4 months ago
- A comprehensive local Linux Privilege-Escalation Benchmark☆38Updated 3 months ago
- The official repository of "GraphSPD: Graph-Based Security Patch Detection with Enriched Code Semantics". The paper will appear in the IE…☆47Updated 2 years ago
- An implementation of the ACL 2024 Findings paper "Generalization-Enhanced Code Vulnerability Detection via Multi-Task Instruction Fine-Tu…☆50Updated last year
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆83Updated 7 months ago
- [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…☆50Updated 5 months ago
- AIBugHunter: A Practical Tool for Predicting, Classifying and Repairing Software Vulnerabilities☆44Updated last year
- ☠️ Ground-truth dataset for vulnerability prediction (known research datasets and data sources included such as NVD, CVE Details and OSV)…☆94Updated last year
- ☆31Updated 2 months ago