A curated list of the most common and most interesting robots.txt disallowed directories.
☆1,487Aug 22, 2022Updated 3 years ago
Alternatives and similar repositories for RobotsDisallowed
Users that are interested in RobotsDisallowed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This tool can be used to brute discover GET and POST parameters☆1,396Aug 24, 2019Updated 6 years ago
- Generates permutations, alterations and mutations of subdomains and then resolves them☆2,495Jan 9, 2025Updated last year
- EyeWitness is designed to take screenshots of websites, provide some server header info, and identify default credentials if possible.☆5,720Jan 5, 2026Updated 4 months ago
- Setup script for Regon-ng☆940Nov 17, 2020Updated 5 years ago
- ☆2,326Dec 8, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Tool for Domain Flyovers☆5,931May 22, 2022Updated 3 years ago
- A collection of Burpsuite Intruder payloads, BurpBounty payloads, fuzz lists, malicious file uploads and web pentesting methodologies and…☆3,936Sep 27, 2021Updated 4 years ago
- A python script that finds endpoints in JavaScript files☆4,350Apr 13, 2024Updated 2 years ago
- A high-performance DNS stub resolver for bulk lookups and reconnaissance (subdomain enumeration)☆3,588Apr 15, 2026Updated last month
- Cloudflare DNS Enumeration Tool for Pentesters☆524Aug 6, 2022Updated 3 years ago
- Dictionary of attack patterns and primitives for black-box application fault injection and resource discovery.☆8,902Nov 10, 2023Updated 2 years ago
- Fast subdomains enumeration tool for penetration testers☆10,929Aug 2, 2024Updated last year
- "Can I take over XYZ?" — a list of services and how to claim (sub)domains with dangling DNS records.☆5,668Feb 8, 2025Updated last year
- A container repository for my public web hacks!☆2,023Oct 12, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Finds unknown classes of injection vulnerabilities☆711Apr 30, 2025Updated last year
- Reconnaissance tool for GitHub organizations☆6,174Sep 20, 2022Updated 3 years ago
- The Bug Hunters Methodology☆4,325Aug 1, 2023Updated 2 years ago
- bXSS is a utility which can be used by bug hunters and organizations to identify Blind Cross-Site Scripting.☆572Mar 4, 2023Updated 3 years ago
- ☆840Nov 13, 2023Updated 2 years ago
- This script is intended to automate your reconnaissance process in an organized fashion☆2,034Aug 19, 2021Updated 4 years ago
- Vulnerability scanner based on vulners.com search API☆889Oct 1, 2025Updated 7 months ago
- Server-Side Template Injection and Code Injection Detection and Exploitation Tool☆4,155Apr 21, 2024Updated 2 years ago
- A collection of scripts that run on my web server. Mainly for debugging SSRF, blind XSS, and XXE vulnerabilities.☆549Jun 12, 2017Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- SecLists is the security tester's companion. It's a collection of multiple types of lists used during security assessments, collected in …☆70,971Updated this week
- An automation framework for running multiple open sourced subdomain bruteforcing tools (in parallel) using your own wordlists via Docker …☆259Aug 22, 2021Updated 4 years ago
- A small tool that extracts relative URLs from a file.☆768Sep 23, 2020Updated 5 years ago
- SSRF (Server Side Request Forgery) testing resources☆2,494Oct 12, 2024Updated last year
- Automated All-in-One OS Command Injection Exploitation Tool☆5,733May 1, 2026Updated 2 weeks ago
- Knock Subdomain Scan☆4,164Feb 19, 2026Updated 3 months ago
- A virtual host scanner that performs reverse lookups, can be used with pivot tools, detect catch-all scenarios, work around wildcards, al…☆1,293Aug 18, 2025Updated 9 months ago
- Content discovery wordlists generated using BigQuery☆581Apr 26, 2020Updated 6 years ago
- The XSS Hunter service - a portable version of XSSHunter.com☆1,548Dec 7, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Wordlists that have been compiled using Commonspeak2. This repo is updated every time new wordlists are generated.☆544Aug 23, 2018Updated 7 years ago
- Security Tool to Look For Interesting Files in S3 Buckets☆1,463Apr 10, 2024Updated 2 years ago
- A DNS meta-query spider that enumerates DNS records, and subdomains.☆3,510Jan 13, 2022Updated 4 years ago
- Directory/File, DNS and VHost busting tool written in Go☆13,696May 9, 2026Updated last week
- Git All the Payloads! A collection of web attack payloads.☆3,946May 15, 2023Updated 3 years ago
- A swiss army knife for pentesting networks☆9,134Dec 6, 2023Updated 2 years ago
- DNS Takeover tool written in Go☆2,065Mar 16, 2026Updated 2 months ago