lucagioacchini / auto-pen-benchLinks
This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking Generative Agents for Penetration Testing". It contains also the instructions to install, develop and test new vulnerable containers to include in the benchmark.
☆32Updated 8 months ago
Alternatives and similar repositories for auto-pen-bench
Users that are interested in auto-pen-bench are comparing it to the libraries listed below
Sorting:
- The repository of VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework.☆72Updated 2 months ago
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆81Updated 2 months ago
- The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".☆121Updated last year
- Benchmark data from the article "AutoPT: How Far Are We from End2End Automated Web Penetration Testing?"☆16Updated 7 months ago
- ☆55Updated last month
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆58Updated last month
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆58Updated last week
- ☆43Updated 8 months ago
- CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.☆43Updated 6 months ago
- ☆112Updated 2 weeks ago
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆82Updated 4 months ago
- CyberMetric dataset☆91Updated 5 months ago
- PentestAgent is a novel LLM-driven penetration testing framework to automate intelligence gathering, vulnerability analysis, and exploita…☆52Updated 2 weeks ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆21Updated 2 weeks ago
- The goal of this repo is to become a benchmark for pentesting☆12Updated 8 months ago
- Awesome Large Language Models for Vulnerability Detection☆160Updated this week
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆76Updated 5 months ago
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆71Updated last year
- An autonomous LLM-agent for large-scale, repository-level code auditing☆82Updated 2 weeks ago
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆82Updated 2 months ago
- A collection of security papers on top-tier publications☆43Updated this week
- This is a dataset intended to train a LLM model for a completely CVE focused input and output.☆60Updated 7 months ago
- TensorFlow API analysis tool and malicious model detection tool☆32Updated 3 weeks ago
- Hey folks, this is a repository for papers on LLM for Vuln. Detection area☆51Updated 2 months ago
- ☆35Updated 11 months ago
- This is The most comprehensive prompt hacking course available, which record our progress on a prompt engineering and prompt hacking cour…☆84Updated 2 months ago
- [USENIX Security '24] An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities agai…☆47Updated 3 months ago
- This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.☆212Updated 2 months ago
- The Pentest Agent System is an autonomous penetration testing framework built on the MITRE ATT&CK framework.☆14Updated 2 months ago
- A comprehensive local Linux Privilege-Escalation Benchmark☆36Updated last month