lucagioacchini / auto-pen-benchLinks
This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking Generative Agents for Penetration Testing". It contains also the instructions to install, develop and test new vulnerable containers to include in the benchmark.
☆35Updated last month
Alternatives and similar repositories for auto-pen-bench
Users that are interested in auto-pen-bench are comparing it to the libraries listed below
Sorting:
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆86Updated 6 months ago
- The repository of VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework.☆86Updated 4 months ago
- The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".☆126Updated last year
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆91Updated last week
- Benchmark data from the article "AutoPT: How Far Are We from End2End Automated Web Penetration Testing?"☆17Updated 9 months ago
- ☆63Updated 3 months ago
- CyberMetric dataset☆93Updated 7 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆512Updated 10 months ago
- ☆130Updated last month
- CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.☆43Updated 8 months ago
- PentestAgent is a novel LLM-driven penetration testing framework to automate intelligence gathering, vulnerability analysis, and exploita…☆58Updated last week
- This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.☆229Updated last week
- ☆35Updated last year
- MCPSafetyScanner - Automated MCP safety auditing and remediation using Agents. More info: https://www.arxiv.org/abs/2504.03767☆101Updated 3 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆73Updated 2 weeks ago
- ☆26Updated 9 months ago
- This is a dataset intended to train a LLM model for a completely CVE focused input and output.☆63Updated last month
- The automated prompt injection framework for LLM-integrated applications.☆221Updated 10 months ago
- A Test Project for a Network Security-oriented LLM Tool Emulating AutoGPT☆288Updated last year
- PenGym: Pentesting Training Framework for Reinforcement Learning Agents☆38Updated 7 months ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆49Updated last week
- ☆47Updated 10 months ago
- Guardrails for secure and robust agent development☆327Updated last week
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆57Updated 3 months ago
- Awesome Large Language Models for Vulnerability Detection☆207Updated this week
- ☆70Updated last year
- LLM Agent and Evaluation Framework for Autonomous Penetration Testing☆197Updated last month
- Code snippets to reproduce MCP tool poisoning attacks.☆164Updated 3 months ago
- AutoAudit—— the LLM for Cyber Security 网络安全大语言模型☆343Updated 5 months ago
- The goal of this repo is to become a benchmark for pentesting☆13Updated 9 months ago