ghostlulzhacks/crawler external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

ghostlulzhacks/crawler

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/ghostlulzhacks/crawler)

Close

ghostlulzhacks / crawlerView on GitHubMore

• External links
• Readme badge

Crawl website extract links

☆57Jun 1, 2020Updated 5 years ago

Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• ghostlulzhacks / commoncrawl

  View on GitHub
  Gathers urls from common crawl
  ☆34Nov 9, 2019Updated 6 years ago
• ghostlulzhacks / s3brute

  View on GitHub
  s3 brute force tool
  ☆44May 7, 2021Updated 4 years ago
• ghostlulzhacks / CertificateTransparencyLogs

  View on GitHub
  ☆52Apr 2, 2021Updated 4 years ago
• incogbyte / jsearch

  View on GitHub
  ☆31Apr 6, 2021Updated 4 years ago
• ghostlulzhacks / waybackMachine

  View on GitHub
  ☆61Feb 15, 2021Updated 5 years ago
• vincd / wappylyzer

  View on GitHub
  Implementation of Wappalyzer in Python
  ☆55Dec 8, 2022Updated 3 years ago
• ethicalhackingplayground / linkJS

  View on GitHub
  ☆57Sep 2, 2020Updated 5 years ago
• mrnitesh / WSDL

  View on GitHub
  It contain google dork to find the wsdl file.
  ☆13May 27, 2020Updated 5 years ago
• random-robbie / angularjs-csti-scanner

  View on GitHub
  Automated client-side template injection (sandbox escape/bypass) detection for AngularJS.
  ☆11Dec 14, 2025Updated 2 months ago
• ethicalhackingplayground / Gxss

  View on GitHub
  Tool for checking reflecting Parameters in a URL.
  ☆10Aug 31, 2020Updated 5 years ago
• gremwell / apkscanner

  View on GitHub
  Android application penetration testing for the masses.
  ☆13Apr 12, 2019Updated 6 years ago
• akhil-reni / ud-peep

  View on GitHub
  Search for secrets inside user data attached to EC2 instances on multiple AWS accounts
  ☆16Jun 19, 2024Updated last year
• njmulsqb / DVEA

  View on GitHub
  Damn Vulnerable ElectronJS App (DVEA)
  ☆17Feb 12, 2026Updated 2 weeks ago
• arg3t / massurl

  View on GitHub
  A simple tool that aims to efficiently and quickly parse the outputs of web scraping tools like gau
  ☆12Jun 28, 2021Updated 4 years ago
• r00tgate / bugbounty101

  View on GitHub
  An entry level resource to learning bug bounty.
  ☆28Apr 11, 2018Updated 7 years ago
• sw33tLie / ugly-scripts

  View on GitHub
  A collection of scripts for bug-bounty related stuff
  ☆39Sep 4, 2020Updated 5 years ago
• appsecco / spaces-finder

  View on GitHub
  A tool to hunt for publicly accessible DigitalOcean Spaces
  ☆156Jan 21, 2020Updated 6 years ago
• Shapa7276 / Android-Deeplink-Parser

  View on GitHub
  ☆48Dec 26, 2024Updated last year
• edduu / Arjun

  View on GitHub
  HTTP parameter discovery suite.
  ☆93Apr 16, 2020Updated 5 years ago
• dubey-amit / Web-Cheatsheet

  View on GitHub
  Vulnerability Cheatsheet
  ☆54Apr 22, 2022Updated 3 years ago
• 0xbharath / assets-from-spf

  View on GitHub
  A Python script to parse net blocks & domain names from SPF record
  ☆85Jun 2, 2020Updated 5 years ago
• KathanP19 / OpenBB-Scope

  View on GitHub
  OpenBugBounty - https://www.openbugbounty.org/ programs list
  ☆23Mar 15, 2021Updated 4 years ago
• random-robbie / s3-tko

  View on GitHub
  AWS S3 Bucket Finder.
  ☆14Oct 28, 2025Updated 4 months ago
• alifathi-h1 / gh_scanner

  View on GitHub
  GH Scanner Tool is written in Python3 and designed for penetration testers and bug bounty hunters to scan Organization/User repositories …
  ☆34Jul 13, 2025Updated 7 months ago
• random-robbie / AutoRecon

  View on GitHub
  Simple shell script for automated domain recognition with some tools
  ☆20Mar 9, 2019Updated 6 years ago
• rockybhai0516 / maha

  View on GitHub
  ☆14Oct 1, 2021Updated 4 years ago
• random-robbie / extract-m3u

  View on GitHub
  Extract username and passwords from IPTV urls
  ☆12Nov 8, 2025Updated 3 months ago
• TheCrysp / Gitty

  View on GitHub
  ☆13Feb 26, 2021Updated 5 years ago
• ph4nt0m-py / login-panel-wordlist

  View on GitHub
  ☆32Dec 30, 2022Updated 3 years ago
• internetwache / CT_subdomains

  View on GitHub
  An hourly updated list of subdomains gathered from certificate transparency logs
  ☆349Oct 13, 2021Updated 4 years ago
• si9int / ScreenShooter

  View on GitHub
  Convert your masscan/subdomain-scan results (80,443,8080) into screenshots for better analysis
  ☆36Jul 10, 2018Updated 7 years ago
• Abdulrahman-Kamel / dpfilter

  View on GitHub
  BugBounty , sort and delete duplicates param value without missing original value
  ☆22Jul 31, 2021Updated 4 years ago
• Regala / burp-graphql-logger

  View on GitHub
  Burp Suite extension to log GraphQL operations as a comment
  ☆23Aug 9, 2021Updated 4 years ago
• sec-it / BFAC-Burp-Extension

  View on GitHub
  Burp Extension for BFAC (Advanced Backup-File Artifacts Testing for Web-Applications)
  ☆20Aug 9, 2021Updated 4 years ago
• ghsec / ghsec-jaeles-signatures

  View on GitHub
  Signatures for jaeles scanner by @j3ssie
  ☆117Apr 20, 2024Updated last year
• gwen001 / github-search

  View on GitHub
  A collection of tools to perform searches on GitHub.
  ☆1,467Feb 9, 2023Updated 3 years ago
• AlfredBerg / dnsline

  View on GitHub
  Tool for making it easy to collect dns results from the CLI
  ☆40Aug 14, 2024Updated last year
• PortSwigger / wordlist-extractor

  View on GitHub
  ☆21Oct 9, 2017Updated 8 years ago
• Th0h0 / autoredirect

  View on GitHub
  Smart and efficient tool to automate open redirect detection at scale.
  ☆10Mar 21, 2022Updated 3 years ago