A curated list of the most common and most interesting robots.txt disallowed directories.
☆1,486Aug 22, 2022Updated 3 years ago
Alternatives and similar repositories for RobotsDisallowed
Users that are interested in RobotsDisallowed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This tool can be used to brute discover GET and POST parameters☆1,395Aug 24, 2019Updated 6 years ago
- Generates permutations, alterations and mutations of subdomains and then resolves them☆2,479Jan 9, 2025Updated last year
- EyeWitness is designed to take screenshots of websites, provide some server header info, and identify default credentials if possible.☆5,670Jan 5, 2026Updated 3 months ago
- Setup script for Regon-ng☆939Nov 17, 2020Updated 5 years ago
- ☆2,321Dec 8, 2023Updated 2 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Tool for Domain Flyovers☆5,918May 22, 2022Updated 3 years ago
- A collection of Burpsuite Intruder payloads, BurpBounty payloads, fuzz lists, malicious file uploads and web pentesting methodologies and…☆3,912Sep 27, 2021Updated 4 years ago
- A python script that finds endpoints in JavaScript files☆4,322Apr 13, 2024Updated last year
- A high-performance DNS stub resolver for bulk lookups and reconnaissance (subdomain enumeration)☆3,557Jul 21, 2025Updated 8 months ago
- Cloudflare DNS Enumeration Tool for Pentesters☆523Aug 6, 2022Updated 3 years ago
- Dictionary of attack patterns and primitives for black-box application fault injection and resource discovery.☆8,863Nov 10, 2023Updated 2 years ago
- Fast subdomains enumeration tool for penetration testers☆10,871Aug 2, 2024Updated last year
- "Can I take over XYZ?" — a list of services and how to claim (sub)domains with dangling DNS records.☆5,613Feb 8, 2025Updated last year
- A container repository for my public web hacks!☆2,022Oct 12, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Finds unknown classes of injection vulnerabilities☆710Apr 30, 2025Updated 11 months ago
- Reconnaissance tool for GitHub organizations☆6,156Sep 20, 2022Updated 3 years ago
- The Bug Hunters Methodology☆4,273Aug 1, 2023Updated 2 years ago
- bXSS is a utility which can be used by bug hunters and organizations to identify Blind Cross-Site Scripting.☆570Mar 4, 2023Updated 3 years ago
- ☆834Nov 13, 2023Updated 2 years ago
- This script is intended to automate your reconnaissance process in an organized fashion☆2,028Aug 19, 2021Updated 4 years ago
- Vulnerability scanner based on vulners.com search API☆886Oct 1, 2025Updated 6 months ago
- Server-Side Template Injection and Code Injection Detection and Exploitation Tool☆4,132Apr 21, 2024Updated last year
- A collection of scripts that run on my web server. Mainly for debugging SSRF, blind XSS, and XXE vulnerabilities.☆549Jun 12, 2017Updated 8 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- SecLists is the security tester's companion. It's a collection of multiple types of lists used during security assessments, collected in …☆70,044Updated this week
- An automation framework for running multiple open sourced subdomain bruteforcing tools (in parallel) using your own wordlists via Docker …☆260Aug 22, 2021Updated 4 years ago
- A small tool that extracts relative URLs from a file.☆768Sep 23, 2020Updated 5 years ago
- SSRF (Server Side Request Forgery) testing resources☆2,481Oct 12, 2024Updated last year
- Automated All-in-One OS Command Injection Exploitation Tool☆5,698Mar 28, 2026Updated last week
- Knock Subdomain Scan☆4,153Feb 19, 2026Updated last month
- A virtual host scanner that performs reverse lookups, can be used with pivot tools, detect catch-all scenarios, work around wildcards, al…☆1,287Aug 18, 2025Updated 7 months ago
- Content discovery wordlists generated using BigQuery☆581Apr 26, 2020Updated 5 years ago
- The XSS Hunter service - a portable version of XSSHunter.com☆1,544Dec 7, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Wordlists that have been compiled using Commonspeak2. This repo is updated every time new wordlists are generated.☆543Aug 23, 2018Updated 7 years ago
- Security Tool to Look For Interesting Files in S3 Buckets☆1,459Apr 10, 2024Updated last year
- A DNS meta-query spider that enumerates DNS records, and subdomains.☆3,507Jan 13, 2022Updated 4 years ago
- Directory/File, DNS and VHost busting tool written in Go☆13,572Mar 27, 2026Updated last week
- Git All the Payloads! A collection of web attack payloads.☆3,930May 15, 2023Updated 2 years ago
- A swiss army knife for pentesting networks☆9,112Dec 6, 2023Updated 2 years ago
- A default credential scanner.☆1,504Jul 8, 2025Updated 8 months ago