isamu-isozaki / AI-Pentest-BenchmarkLinks
The goal of this repo is to become a benchmark for pentesting
☆17Updated last year
Alternatives and similar repositories for AI-Pentest-Benchmark
Users that are interested in AI-Pentest-Benchmark are comparing it to the libraries listed below
Sorting:
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆56Updated 2 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆131Updated last month
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆114Updated 2 months ago
- ☆125Updated last year
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆63Updated 7 months ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆101Updated 2 months ago
- An autonomous LLM-agent for large-scale, repository-level code auditing☆296Updated 3 weeks ago
- ☆182Updated 2 weeks ago
- ☆31Updated last year
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆91Updated 11 months ago
- TensorFlow API analysis tool and malicious model detection tool☆37Updated 7 months ago
- A Novel Benchmark evaluating the Deep Capability of Vulnerability Detection with Large Language Models☆32Updated 8 months ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆389Updated last month
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆82Updated 2 years ago
- Automated Benchmarking of LLM Agents on Real-World Software Security Tasks [NeurIPS 2025]☆46Updated last month
- Repository for PrimeVul Vulnerability Detection Dataset☆208Updated last year
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆101Updated 11 months ago
- ☆106Updated 3 months ago
- The automated prompt injection framework for LLM-integrated applications.☆246Updated last year
- PentestAgent is a novel LLM-driven penetration testing framework to automate intelligence gathering, vulnerability analysis, and exploita…☆101Updated last week
- A neurosymbolic framework for vulnerability detection in code☆294Updated 3 weeks ago
- Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study☆36Updated 9 months ago
- CVEfixes: Automated Collection of Vulnerabilities and Their Fixes from Open-Source Software☆310Updated last year
- WhiteFox: White-Box Compiler Fuzzing Empowered by Large Language Models (OOPSLA 2024)☆74Updated 4 months ago
- Source code for LLMxCPG paper☆95Updated last week
- ☆54Updated last year
- tool of llm-based indirect-call analyzer☆32Updated 10 months ago
- ☆80Updated 2 months ago
- Awesome Large Language Models for Vulnerability Detection☆336Updated this week
- The repository of VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework.☆128Updated 8 months ago