hueristiq / xcrawl3rLinks
A command-line utility designed to recursively spider webpages for URLs. It works by actively traversing websites - following links embedded in webpages, parsing resources like sitemaps and robots.txt files, and even processing local files - to uncover every URL.
☆103Updated last month
Alternatives and similar repositories for xcrawl3r
Users that are interested in xcrawl3r are comparing it to the libraries listed below
Sorting:
- A command-line utility designed to discover subdomains for a given domain in a simple, efficient way. It works by gathering information f…☆115Updated last month
- Origin IP scanning utility developed with ChatGPT☆69Updated 2 years ago
- Exposor is a tool using internet search engines to detect exposed technologies with a unified syntax.☆64Updated 2 months ago
- External recon toolkit☆54Updated last year
- Extracting OSINT Insights from 15TB of GitHub Event Logs☆69Updated 2 years ago
- A command-line utility for performing reverse DNS lookups☆74Updated 2 years ago
- Repo for hosting rayder workflows☆63Updated 2 years ago
- Scanner for CVE-2023-22515 - Broken Access Control Vulnerability in Atlassian Confluence☆77Updated 2 years ago
- Burp Suite extension to encode an IP address focused to bypass application IP / domain blacklist.☆46Updated last year
- CVE-2023-7028☆59Updated 2 years ago
- Mining URLs from Wayback Machine for bug hunting/fuzzing/further probing☆54Updated 2 years ago
- Unofficial Acunetix CLI tool for automated pentesting and bug hunting across large scopes.☆84Updated 2 years ago
- an exploit of Server-side request forgery (SSRF)☆50Updated last year
- Burp Suite extension that makes your life easier by tucking the headers out of the way, so you can see the body content right away withou…☆39Updated 2 years ago
- Help recon of hostnames from specific ASN or CIDR, thanks to Robtex and BGP.HE☆54Updated last year
- This repository contains the best fuzzing wordlist files☆33Updated last year
- A Burp Suite extension for finding DNS vulnerabilities in web applications!☆94Updated 2 years ago
- WEB-Wordlist-Generator creates related wordlists after scanning your web applications.☆52Updated last year
- A Lightning-Fast DNS Resolver written in Rust 🦀☆68Updated last year
- CVE-2024-21893: SSRF Vulnerability in Ivanti Connect Secure☆96Updated last year
- Run ffuf with the appropriate options to brute-force the directories using the awesome different wordlists.☆25Updated 2 years ago
- ☆47Updated 10 months ago
- Striping CDN & WAF IPs from a list of IP Addresses☆80Updated 8 months ago
- ☆28Updated 5 years ago
- NoBlindi is a command-line tool for exploiting blind NoSQL injection vulnerabilities to recover passwords in web applications.☆28Updated 2 years ago
- Probuster : A Python based Web Application Penetration testing tool for Information Gathering⚡.☆60Updated last year
- a simple discovery script that uses popular tools like subfinder, amass, puredns, alterx, massdns and others☆84Updated 2 years ago
- Url scrapper or extractor from alienvault☆38Updated 10 months ago
- Python tool to test known techniques to bypass 403 and 401 HTTP responses.☆36Updated 2 years ago
- The perfect butler for pentesters, bug-bounty hunters and security researchers☆93Updated last year