A curated list of the most common and most interesting robots.txt disallowed directories.
☆1,484Aug 22, 2022Updated 3 years ago
Alternatives and similar repositories for RobotsDisallowed
Users that are interested in RobotsDisallowed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This tool can be used to brute discover GET and POST parameters☆1,395Aug 24, 2019Updated 6 years ago
- Generates permutations, alterations and mutations of subdomains and then resolves them☆2,488Jan 9, 2025Updated last year
- EyeWitness is designed to take screenshots of websites, provide some server header info, and identify default credentials if possible.☆5,700Jan 5, 2026Updated 3 months ago
- Setup script for Regon-ng☆939Nov 17, 2020Updated 5 years ago
- ☆2,323Dec 8, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Tool for Domain Flyovers☆5,927May 22, 2022Updated 3 years ago
- A collection of Burpsuite Intruder payloads, BurpBounty payloads, fuzz lists, malicious file uploads and web pentesting methodologies and…☆3,927Sep 27, 2021Updated 4 years ago
- A python script that finds endpoints in JavaScript files☆4,334Apr 13, 2024Updated 2 years ago
- A high-performance DNS stub resolver for bulk lookups and reconnaissance (subdomain enumeration)☆3,577Apr 15, 2026Updated 2 weeks ago
- Cloudflare DNS Enumeration Tool for Pentesters☆524Aug 6, 2022Updated 3 years ago
- Dictionary of attack patterns and primitives for black-box application fault injection and resource discovery.☆8,886Nov 10, 2023Updated 2 years ago
- Fast subdomains enumeration tool for penetration testers☆10,887Aug 2, 2024Updated last year
- "Can I take over XYZ?" — a list of services and how to claim (sub)domains with dangling DNS records.☆5,639Feb 8, 2025Updated last year
- A container repository for my public web hacks!☆2,023Oct 12, 2022Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Finds unknown classes of injection vulnerabilities☆710Apr 30, 2025Updated 11 months ago
- Reconnaissance tool for GitHub organizations☆6,161Sep 20, 2022Updated 3 years ago
- The Bug Hunters Methodology☆4,311Aug 1, 2023Updated 2 years ago
- bXSS is a utility which can be used by bug hunters and organizations to identify Blind Cross-Site Scripting.☆569Mar 4, 2023Updated 3 years ago
- ☆835Nov 13, 2023Updated 2 years ago
- This script is intended to automate your reconnaissance process in an organized fashion☆2,033Aug 19, 2021Updated 4 years ago
- Vulnerability scanner based on vulners.com search API☆889Oct 1, 2025Updated 6 months ago
- Server-Side Template Injection and Code Injection Detection and Exploitation Tool☆4,148Apr 21, 2024Updated 2 years ago
- A collection of scripts that run on my web server. Mainly for debugging SSRF, blind XSS, and XXE vulnerabilities.☆549Jun 12, 2017Updated 8 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- An automation framework for running multiple open sourced subdomain bruteforcing tools (in parallel) using your own wordlists via Docker …☆259Aug 22, 2021Updated 4 years ago
- A small tool that extracts relative URLs from a file.☆767Sep 23, 2020Updated 5 years ago
- SSRF (Server Side Request Forgery) testing resources☆2,489Oct 12, 2024Updated last year
- Automated All-in-One OS Command Injection Exploitation Tool☆5,716Apr 23, 2026Updated last week
- Knock Subdomain Scan☆4,157Feb 19, 2026Updated 2 months ago
- A virtual host scanner that performs reverse lookups, can be used with pivot tools, detect catch-all scenarios, work around wildcards, al…☆1,289Aug 18, 2025Updated 8 months ago
- Content discovery wordlists generated using BigQuery☆579Apr 26, 2020Updated 6 years ago
- The XSS Hunter service - a portable version of XSSHunter.com☆1,546Dec 7, 2022Updated 3 years ago
- Wordlists that have been compiled using Commonspeak2. This repo is updated every time new wordlists are generated.☆543Aug 23, 2018Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Security Tool to Look For Interesting Files in S3 Buckets☆1,460Apr 10, 2024Updated 2 years ago
- A DNS meta-query spider that enumerates DNS records, and subdomains.☆3,508Jan 13, 2022Updated 4 years ago
- Directory/File, DNS and VHost busting tool written in Go☆13,638Apr 21, 2026Updated last week
- Git All the Payloads! A collection of web attack payloads.☆3,934May 15, 2023Updated 2 years ago
- A swiss army knife for pentesting networks☆9,129Dec 6, 2023Updated 2 years ago
- A default credential scanner.☆1,501Jul 8, 2025Updated 9 months ago
- HTTP parameter discovery suite.☆6,209Feb 20, 2025Updated last year