isamu-isozaki / AI-Pentest-BenchmarkLinks
The goal of this repo is to become a benchmark for pentesting
☆19Updated last year
Alternatives and similar repositories for AI-Pentest-Benchmark
Users that are interested in AI-Pentest-Benchmark are comparing it to the libraries listed below
Sorting:
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆59Updated 2 months ago
- ☆126Updated last year
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆63Updated 8 months ago
- ☆31Updated last year
- A Novel Benchmark evaluating the Deep Capability of Vulnerability Detection with Large Language Models☆32Updated 8 months ago
- An autonomous LLM-agent for large-scale, repository-level code auditing☆314Updated last month
- Repository for PrimeVul Vulnerability Detection Dataset☆209Updated last year
- The official repository of the paper "The Digital Cybersecurity Expert: How Far Have We Come?" presented in IEEE S&P 2025☆24Updated 8 months ago
- TensorFlow API analysis tool and malicious model detection tool☆38Updated 7 months ago
- [USENIX Security 25] PatchAgent is a LLM-based practical program repair agent that mimics human expertise.☆117Updated last month
- Source code for LLMxCPG paper☆105Updated 3 weeks ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆116Updated 2 months ago
- The official repository of "GraphSPD: Graph-Based Security Patch Detection with Enriched Code Semantics". The paper will appear in the IE…☆48Updated 2 years ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆136Updated last week
- CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Software☆312Updated last year
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆91Updated last year
- ☆55Updated last year
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆172Updated last year
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆101Updated last week
- MegaVul - The largest, high-quality, extensible, continuously updated, C/C++/Java vulnerability dataset☆132Updated last year
- Awesome Large Language Models for Vulnerability Detection☆354Updated this week
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆102Updated 11 months ago
- The automated prompt injection framework for LLM-integrated applications.☆247Updated last year
- ☆113Updated 3 months ago
- This is a benchmark for evaluating the vulnerability discovery ability of automated approaches including Large Language Models (LLMs), de…☆75Updated last year
- A neurosymbolic framework for vulnerability detection in code☆309Updated last month
- ☆21Updated last year
- [IEEE T-IFS] AutoPT: How Far Are We from the Fully Automated Web Penetration Testing?☆30Updated 5 months ago
- Official repo for FSE'24 paper "CodeArt: Better Code Models by Attention Regularization When Symbols Are Lacking"☆18Updated 10 months ago
- [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…☆56Updated 10 months ago