A curated list of the most common and most interesting robots.txt disallowed directories.
☆1,493Aug 22, 2022Updated 4 years ago
Alternatives and similar repositories for RobotsDisallowed
Users that are interested in RobotsDisallowed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This tool can be used to brute discover GET and POST parameters☆1,397Aug 24, 2019Updated 7 years ago
- Generates permutations, alterations and mutations of subdomains and then resolves them☆2,509Jan 9, 2025Updated last year
- EyeWitness is designed to take screenshots of websites, provide some server header info, and identify default credentials if possible.☆5,853Jan 5, 2026Updated 8 months ago
- Setup script for Regon-ng☆941Nov 17, 2020Updated 5 years ago
- ☆2,339Aug 26, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A Tool for Domain Flyovers☆5,963May 22, 2022Updated 4 years ago
- A collection of Burpsuite Intruder payloads, BurpBounty payloads, fuzz lists, malicious file uploads and web pentesting methodologies and…☆3,980Sep 27, 2021Updated 4 years ago
- A python script that finds endpoints in JavaScript files☆4,448Apr 13, 2024Updated 2 years ago
- A high-performance DNS stub resolver for bulk lookups and reconnaissance (subdomain enumeration)☆3,645Apr 15, 2026Updated 5 months ago
- Dictionary of attack patterns and primitives for black-box application fault injection and resource discovery.☆8,985Nov 10, 2023Updated 2 years ago
- Fast subdomains enumeration tool for penetration testers☆11,042Aug 2, 2024Updated 2 years ago
- Cloudflare DNS Enumeration Tool for Pentesters☆526Aug 6, 2022Updated 4 years ago
- "Can I take over XYZ?" — a list of services and how to claim (sub)domains with dangling DNS records.☆5,814Feb 8, 2025Updated last year
- A container repository for my public web hacks!☆2,037Oct 12, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Finds unknown classes of injection vulnerabilities☆717Apr 30, 2025Updated last year
- Reconnaissance tool for GitHub organizations☆6,199Sep 20, 2022Updated 3 years ago
- The Bug Hunters Methodology☆4,403Aug 1, 2023Updated 3 years ago
- bXSS is a utility which can be used by bug hunters and organizations to identify Blind Cross-Site Scripting.☆578Mar 4, 2023Updated 3 years ago
- This script is intended to automate your reconnaissance process in an organized fashion☆2,041Aug 19, 2021Updated 5 years ago
- ☆847Nov 13, 2023Updated 2 years ago
- Vulnerability scanner based on vulners.com search API☆899Oct 1, 2025Updated 11 months ago
- Server-Side Template Injection and Code Injection Detection and Exploitation Tool☆4,205Apr 21, 2024Updated 2 years ago
- A collection of scripts that run on my web server. Mainly for debugging SSRF, blind XSS, and XXE vulnerabilities.☆548Jun 12, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- SecLists is the security tester's companion. It's a collection of multiple types of lists used during security assessments, collected in …☆73,612Updated this week
- Knock Subdomain Scan☆4,199Feb 19, 2026Updated 7 months ago
- An automation framework for running multiple open sourced subdomain bruteforcing tools (in parallel) using your own wordlists via Docker …☆260Aug 22, 2021Updated 5 years ago
- SSRF (Server Side Request Forgery) testing resources☆2,507Oct 12, 2024Updated last year
- Automated Αll-in-One OS command injection exploitation tool.☆5,850Updated this week
- A virtual host scanner that performs reverse lookups, can be used with pivot tools, detect catch-all scenarios, work around wildcards, al…☆1,311Aug 18, 2025Updated last year
- A small tool that extracts relative URLs from a file.☆767Sep 23, 2020Updated 5 years ago
- Content discovery wordlists generated using BigQuery☆583Apr 26, 2020Updated 6 years ago
- The XSS Hunter service - a portable version of XSSHunter.com☆1,558Dec 7, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Wordlists that have been compiled using Commonspeak2. This repo is updated every time new wordlists are generated.☆547Aug 23, 2018Updated 8 years ago
- A DNS meta-query spider that enumerates DNS records, and subdomains.☆3,535Jan 13, 2022Updated 4 years ago
- Security Tool to Look For Interesting Files in S3 Buckets☆1,474Apr 10, 2024Updated 2 years ago
- Directory/File, DNS and VHost busting tool written in Go☆14,139Sep 9, 2026Updated last week
- A swiss army knife for pentesting networks☆9,162Dec 6, 2023Updated 2 years ago
- DNS Takeover tool written in Go☆2,113Jul 3, 2026Updated 2 months ago
- Git All the Payloads! A collection of web attack payloads.☆3,980May 15, 2023Updated 3 years ago