A curated list of the most common and most interesting robots.txt disallowed directories.
☆1,493Aug 22, 2022Updated 4 years ago
Alternatives and similar repositories for RobotsDisallowed
Users that are interested in RobotsDisallowed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This tool can be used to brute discover GET and POST parameters☆1,397Aug 24, 2019Updated 7 years ago
- Generates permutations, alterations and mutations of subdomains and then resolves them☆2,506Jan 9, 2025Updated last year
- EyeWitness is designed to take screenshots of websites, provide some server header info, and identify default credentials if possible.☆5,860Jan 5, 2026Updated 8 months ago
- Setup script for Regon-ng☆941Nov 17, 2020Updated 5 years ago
- ☆2,337Aug 26, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A Tool for Domain Flyovers☆5,957May 22, 2022Updated 4 years ago
- A collection of Burpsuite Intruder payloads, BurpBounty payloads, fuzz lists, malicious file uploads and web pentesting methodologies and…☆3,983Sep 27, 2021Updated 5 years ago
- A python script that finds endpoints in JavaScript files☆4,451Apr 13, 2024Updated 2 years ago
- A high-performance DNS stub resolver for bulk lookups and reconnaissance (subdomain enumeration)☆3,650Updated this week
- Dictionary of attack patterns and primitives for black-box application fault injection and resource discovery.☆8,993Nov 10, 2023Updated 2 years ago
- Fast subdomains enumeration tool for penetration testers☆11,049Aug 2, 2024Updated 2 years ago
- Cloudflare DNS Enumeration Tool for Pentesters☆525Aug 6, 2022Updated 4 years ago
- "Can I take over XYZ?" — a list of services and how to claim (sub)domains with dangling DNS records.☆5,819Feb 8, 2025Updated last year
- A container repository for my public web hacks!☆2,035Oct 12, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Finds unknown classes of injection vulnerabilities☆717Apr 30, 2025Updated last year
- Reconnaissance tool for GitHub organizations☆6,196Sep 20, 2022Updated 4 years ago
- The Bug Hunters Methodology☆4,404Aug 1, 2023Updated 3 years ago
- bXSS is a utility which can be used by bug hunters and organizations to identify Blind Cross-Site Scripting.☆578Mar 4, 2023Updated 3 years ago
- This script is intended to automate your reconnaissance process in an organized fashion☆2,035Aug 19, 2021Updated 5 years ago
- ☆847Nov 13, 2023Updated 2 years ago
- Vulnerability scanner based on vulners.com search API☆899Oct 1, 2025Updated last year
- Server-Side Template Injection and Code Injection Detection and Exploitation Tool☆4,206Apr 21, 2024Updated 2 years ago
- A collection of scripts that run on my web server. Mainly for debugging SSRF, blind XSS, and XXE vulnerabilities.☆548Jun 12, 2017Updated 9 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- SecLists is the security tester's companion. It's a collection of multiple types of lists used during security assessments, collected in …☆73,906Updated this week
- Knock Subdomain Scan☆4,200Feb 19, 2026Updated 7 months ago
- An automation framework for running multiple open sourced subdomain bruteforcing tools (in parallel) using your own wordlists via Docker …☆261Aug 22, 2021Updated 5 years ago
- SSRF (Server Side Request Forgery) testing resources☆2,504Oct 12, 2024Updated last year
- Automated Αll-in-One OS command injection exploitation tool.☆5,868Updated this week
- A virtual host scanner that performs reverse lookups, can be used with pivot tools, detect catch-all scenarios, work around wildcards, al…☆1,312Aug 18, 2025Updated last year
- A small tool that extracts relative URLs from a file.☆769Sep 23, 2020Updated 6 years ago
- Content discovery wordlists generated using BigQuery☆582Apr 26, 2020Updated 6 years ago
- The XSS Hunter service - a portable version of XSSHunter.com☆1,558Dec 7, 2022Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Wordlists that have been compiled using Commonspeak2. This repo is updated every time new wordlists are generated.☆544Aug 23, 2018Updated 8 years ago
- A DNS meta-query spider that enumerates DNS records, and subdomains.☆3,534Jan 13, 2022Updated 4 years ago
- Security Tool to Look For Interesting Files in S3 Buckets☆1,474Apr 10, 2024Updated 2 years ago
- Directory/File, DNS and VHost busting tool written in Go☆14,182Sep 9, 2026Updated 3 weeks ago
- A swiss army knife for pentesting networks☆9,159Dec 6, 2023Updated 2 years ago
- DNS Takeover tool written in Go☆2,120Jul 3, 2026Updated 3 months ago
- Git All the Payloads! A collection of web attack payloads.☆3,986May 15, 2023Updated 3 years ago