isamu-isozaki / AI-Pentest-BenchmarkLinks
The goal of this repo is to become a benchmark for pentesting
☆16Updated last year
Alternatives and similar repositories for AI-Pentest-Benchmark
Users that are interested in AI-Pentest-Benchmark are comparing it to the libraries listed below
Sorting:
- ☆124Updated last year
- Automated Benchmarking of LLM Agents on Real-World Software Security Tasks [NeurIPS 2025]☆43Updated 2 weeks ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆82Updated 2 years ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆369Updated last week
- An autonomous LLM-agent for large-scale, repository-level code auditing☆282Updated last week
- ☆178Updated 5 months ago
- Official repo for "ProSec: Fortifying Code LLMs with Proactive Security Alignment"☆15Updated 8 months ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆62Updated 7 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆124Updated last month
- ☆54Updated last year
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆98Updated 2 months ago
- Repository for PrimeVul Vulnerability Detection Dataset☆203Updated last year
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆53Updated last month
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆109Updated last month
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆100Updated 10 months ago
- A Novel Benchmark evaluating the Deep Capability of Vulnerability Detection with Large Language Models☆32Updated 7 months ago
- ☆49Updated last year
- ☆31Updated last year
- The automated prompt injection framework for LLM-integrated applications.☆242Updated last year
- ☆76Updated last month
- DiverseVul: A New Vulnerable Source Code Dataset for Deep Learning Based Vulnerability Detection (RAID 2023) https://surrealyz.github.io/…☆169Updated last year
- [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…☆53Updated 8 months ago
- CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Software☆308Updated last year
- TensorFlow API analysis tool and malicious model detection tool☆37Updated 6 months ago
- The official repository of "GraphSPD: Graph-Based Security Patch Detection with Enriched Code Semantics". The paper will appear in the IE…☆48Updated 2 years ago
- Fuzzing Automatic Differentiation in Deep-Learning Libraries (ICSE'23)☆27Updated last year
- Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study☆35Updated 8 months ago
- [2023 TDSC] Pre-trained Model-based Automated Software Vulnerability Repair: How Far are We?☆25Updated 2 years ago
- [TOSEM 2023] A Survey of Learning-based Automated Program Repair☆73Updated last year
- ☆99Updated 2 months ago