lucagioacchini / auto-pen-benchLinks
This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking Generative Agents for Penetration Testing". It contains also the instructions to install, develop and test new vulnerable containers to include in the benchmark.
☆32Updated 7 months ago
Alternatives and similar repositories for auto-pen-bench
Users that are interested in auto-pen-bench are comparing it to the libraries listed below
Sorting:
- Benchmark data from the article "AutoPT: How Far Are We from End2End Automated Web Penetration Testing?"☆15Updated 6 months ago
- The repository of VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework.☆63Updated last month
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆80Updated 4 months ago
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆57Updated last month
- ☆43Updated 8 months ago
- ☆53Updated 3 weeks ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆77Updated last month
- The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".☆119Updated last year
- PentestAgent is a novel LLM-driven penetration testing framework to automate intelligence gathering, vulnerability analysis, and exploita…☆48Updated 2 months ago
- CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.☆42Updated 6 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆71Updated last year
- CyberMetric dataset☆86Updated 5 months ago
- A comprehensive local Linux Privilege-Escalation Benchmark☆34Updated 2 weeks ago
- ☆24Updated 7 months ago
- ☆109Updated 2 weeks ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆53Updated last month
- Resources for our ICSE'24 poster: Prompt-Enhanced Software Vulnerability Detection Using ChatGPT.☆25Updated last year
- TensorFlow API analysis tool and malicious model detection tool☆29Updated last week
- The automated prompt injection framework for LLM-integrated applications.☆211Updated 8 months ago
- This is The most comprehensive prompt hacking course available, which record our progress on a prompt engineering and prompt hacking cour…☆78Updated last month
- [USENIX Security'24] Official repository of "Making Them Ask and Answer: Jailbreaking Large Language Models in Few Queries via Disguise a…☆93Updated 7 months ago
- Awesome Large Language Models for Vulnerability Detection☆121Updated this week
- Academic Papers about LLM Application on Security☆134Updated 3 months ago
- MCPSafetyScanner - Automated MCP safety auditing and remediation using Agents. More info: https://www.arxiv.org/abs/2504.03767☆68Updated last month
- PenGym: Pentesting Training Framework for Reinforcement Learning Agents☆35Updated 5 months ago
- Agent Security Bench (ASB)☆81Updated last month
- This is a dataset intended to train a LLM model for a completely CVE focused input and output.☆60Updated 6 months ago
- A Novel Benchmark evaluating the Deep Capability of Vulnerability Detection with Large Language Models☆25Updated last month
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆81Updated last month
- This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.☆204Updated last month