Alternatives and similar repositories for webcrawler

Users that are interested in webcrawler are comparing it to the libraries listed below

• Shiva108 / WAES
  CPH:SEC WAES: Web Auto Enum & Scanner - Auto enums website(s) and dumps files as result
  ☆72Updated last year
• jevalenciap / iptodomain
  This tool extract domains from IP address based in the information saved in virustotal.
  ☆75Updated 2 years ago
• gwen001 / testxss
  PHP tool to test XSS
  ☆22Updated 5 years ago
• dreadlocked / Cheatsheets
  Helped during my OSCP lab days.
  ☆15Updated 8 years ago
• securityidiots / vhost_buster
  A simple tool with the power of "Go" to find the hidden Vhosts defined at the server.
  ☆19Updated 6 years ago
• censys / nmap-censys
  NSE script which leverages the Censys Search API for passive data collection
  ☆59Updated 3 years ago
• ChrisTruncer / gnmap-parser
  Script to parse multiple Nmap .gnmap exports into various plain-text formats for easy analysis.
  ☆24Updated 11 years ago
• frizb / Powershell-Cheatsheet
  Hand list of Powershell commands frequently used during penetration tests
  ☆14Updated 6 years ago
• c610 / tmp
  tmp files from tmp notes as tmp-pocs... ;)
  ☆16Updated 3 years ago
• pathetiq / ShoScan
  Shodan Port Scanner
  ☆44Updated 4 years ago
• PortSwigger / burp-smart-buster
  A Burp Suite content discovery plugin that add the smart into the Buster!
  ☆32Updated 7 years ago
• cybernova / DNSaxfr
  Shell script for testing DNS zone transfer (AXFR query) on domains and subdomains recursively.
  ☆50Updated 4 years ago
• fnk0c / dot2moon
  Tool that checks for path traversal traces in a given web application url, plus it is capable of multi-threading, set timeout and 5-layer…
  ☆46Updated 7 years ago
• infosec-au / webappsec-toolkit
  Web Application Security related tools. Includes backdoors, proof of concepts and tricks
  ☆37Updated 10 years ago
• codingo / pentest_compilation
  Compilation of commands, tips and scripts that helped me throughout Vulnhub, Hackthebox, OSCP and real scenarios
  ☆14Updated 7 years ago
• ChrisTruncer / mikto
  Script to automate, manage, and multithread Nikto scans.
  ☆61Updated 5 years ago
• random-robbie / wpa-cracking
  Command List for Hashcat and default keyspaces.
  ☆16Updated 5 years ago
• Charlie-belmer / subdomain_recon
  A subdomain reconnaissance scanner
  ☆35Updated 2 years ago
• zeropwn / dnsdmpstr
  Unofficial API & Client for dnsdumpster.com and hackertarget.com
  ☆66Updated 6 years ago
• lolwaleet / ReverseIP
  Ruby based reverse IP-lookup tool.
  ☆57Updated 4 years ago
• guifre / notes
  random notes
  ☆46Updated last month
• lc / cspparse
  A tool to evaluate Content Security Policies.
  ☆72Updated 5 years ago
• dsopas / XSS-oneliner-payload
  Compilation of JavaScript XSS oneliners payloads that rocks your nuts!
  ☆25Updated 8 years ago
• nahamsec / burpy
  Portable and flexible web application security assessment tool.It parses Burp Suite log and performs various tests depending on the modul…
  ☆36Updated 9 years ago
• jivoi / Cheatsheets
  Penetration Testing/Security Cheatsheets
  ☆61Updated 9 years ago
• thegsoinfosec / web-app
  Tools and resources for web app hacking. The payloads.txt documents are a must have for your Burpsuite intruder payload armory. They've h…
  ☆28Updated 6 years ago
• samhaxr / TakeOver-v1
  Takeover script extracts CNAME record of all subdomains at once. TakeOver saves researcher time and increase the chance of finding subdom…
  ☆101Updated 2 years ago
• EdOverflow / h1-cli
  A CLI tool to interact with hackerone.com. This was my submission for HackerOne's Summer 2018 Hack Day.
  ☆39Updated 7 years ago
• GONZOsint / pywhatcms
  Unofficial WhatCMS API package
  ☆42Updated 4 years ago
• scipag / httprecon-win32
  Advanced web server fingerprinting
  ☆22Updated 7 years ago