lucagioacchini / auto-pen-benchLinks
This repo contains the codes of the penetration test benchmark for Generative Agents presented in the paper "AutoPenBench: Benchmarking Generative Agents for Penetration Testing". It contains also the instructions to install, develop and test new vulnerable containers to include in the benchmark.
☆45Updated 2 weeks ago
Alternatives and similar repositories for auto-pen-bench
Users that are interested in auto-pen-bench are comparing it to the libraries listed below
Sorting:
- ☆94Updated last month
- The D-CIPHER and NYU CTF baseline LLM Agents built for NYU CTF Bench☆99Updated this week
- An Execution Isolation Architecture for LLM-Based Agentic Systems☆95Updated 9 months ago
- CVE-Bench: A Benchmark for AI Agents’ Ability to Exploit Real-World Web Application Vulnerabilities☆106Updated last week
- SecLLMHolmes is a generalized, fully automated, and scalable framework to systematically evaluate the performance (i.e., accuracy and rea…☆60Updated 5 months ago
- ☆50Updated last year
- The repository of VulnBot: Autonomous Penetration Testing for A Multi-Agent Collaborative Framework.☆106Updated 6 months ago
- CyberMetric dataset☆106Updated 9 months ago
- CyberGym is a large-scale, high-quality cybersecurity evaluation framework designed to rigorously assess the capabilities of AI agents on…☆83Updated 3 weeks ago
- The repository of paper "HackMentor: Fine-Tuning Large Language Models for Cybersecurity".☆130Updated last year
- The automated prompt injection framework for LLM-integrated applications.☆235Updated last year
- ☆165Updated 4 months ago
- A curated list of awesome resources about LLM supply chain security (including papers, security reports and CVEs)☆87Updated 9 months ago
- [IEEE T-IFS] AutoPT: How Far Are We from the Fully Automated Web Penetration Testing?☆22Updated 2 months ago
- Official repo for GPTFUZZER : Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts☆533Updated last year
- CS-Eval is a comprehensive evaluation suite for fundamental cybersecurity models or large language models' cybersecurity ability.☆54Updated 11 months ago
- 🧠 LLMFuzzer - Fuzzing Framework for Large Language Models 🧠 LLMFuzzer is the first open-source fuzzing framework specifically designed …☆321Updated last year
- This is a dataset intended to train a LLM model for a completely CVE focused input and output.☆63Updated 4 months ago
- Awesome Large Language Models for Vulnerability Detection☆285Updated this week
- PentestAgent is a novel LLM-driven penetration testing framework to automate intelligence gathering, vulnerability analysis, and exploita…☆83Updated last week
- An autonomous LLM-agent for large-scale, repository-level code auditing☆250Updated last week
- Repository for "SecurityEval Dataset: Mining Vulnerability Examples to Evaluate Machine Learning-Based Code Generation Techniques" publis…☆80Updated last year
- The repository has collected about 10,000 malicious pypi packages. This dataset is the work of the ASE 2023 paper "An Empirical Study of…☆105Updated 2 weeks ago
- [CCS'24] An LLM-based, fully automated fuzzing tool for option combination testing.☆91Updated 6 months ago
- TensorFlow API analysis tool and malicious model detection tool☆36Updated 5 months ago
- This project aims to consolidate and share high-quality resources and tools across the cybersecurity domain.☆266Updated 2 weeks ago
- A Dynamic Environment to Evaluate Attacks and Defenses for LLM Agents.☆328Updated 2 weeks ago
- The goal of this repo is to become a benchmark for pentesting☆16Updated last year
- PenGym: Pentesting Training Framework for Reinforcement Learning Agents☆45Updated 10 months ago
- Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study☆33Updated 7 months ago