isamu-isozaki / AI-Pentest-BenchmarkLinks
The goal of this repo is to become a benchmark for pentesting
☆12Updated 8 months ago
Alternatives and similar repositories for AI-Pentest-Benchmark
Users that are interested in AI-Pentest-Benchmark are comparing it to the libraries listed below
Sorting:
- An autonomous LLM-agent for large-scale, repository-level code auditing☆82Updated 2 weeks ago
- ☆116Updated 11 months ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆58Updated last month
- This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking G…☆32Updated 8 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆71Updated last year
- Official repo for "ProSec: Fortifying Code LLMs with Proactive Security Alignment"☆14Updated 3 months ago
- ☆28Updated 9 months ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆21Updated 2 weeks ago
- ☆112Updated 2 weeks ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆81Updated 2 months ago
- TensorFlow API analysis tool and malicious model detection tool☆32Updated 3 weeks ago
- The official repository of the paper "The Digital Cybersecurity Expert: How Far Have We Come?" presented in IEEE S&P 2025☆18Updated last month
- CodeGuard+: Constrained Decoding for Secure Code Generation☆11Updated 10 months ago
- WhiteFox: White-Box Compiler Fuzzing Empowered by Large Language Models (OOPSLA 2024)☆61Updated 7 months ago
- ☆43Updated 8 months ago
- Benchmark data from the article "AutoPT: How Far Are We from End2End Automated Web Penetration Testing?"☆16Updated 7 months ago
- ☆55Updated last month
- [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…☆47Updated 3 months ago
- ☆11Updated 8 months ago
- ☆42Updated 11 months ago
- Repository for PrimeVul Vulnerability Detection Dataset☆154Updated 9 months ago
- Dataset for the Tensor Trust project☆42Updated last year
- A novel approach to improve the safety of large language models, enabling them to transition effectively from unsafe to safe state.☆61Updated last month
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆58Updated last week
- A Novel Benchmark evaluating the Deep Capability of Vulnerability Detection with Large Language Models☆25Updated 2 months ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆82Updated 4 months ago
- Open-source code for RFCNLP paper.☆58Updated 2 years ago
- The official repository of "GraphSPD: Graph-Based Security Patch Detection with Enriched Code Semantics". The paper will appear in the IE…☆45Updated last year
- Official repo for FSE'24 paper "CodeArt: Better Code Models by Attention Regularization When Symbols Are Lacking"☆16Updated 3 months ago
- Fuzzing Automatic Differentiation in Deep-Learning Libraries (ICSE'23)☆23Updated last year