Alternatives and similar repositories for spidy:

Users that are interested in spidy are comparing it to the libraries listed below

• s0md3v / goop
  Google Search Scraper
  ☆566Updated 5 years ago
• michaelhelmick / lassie
  Web Content Retrieval for Humans™
  ☆620Updated 2 years ago
• needmorecowbell / Hamburglar
  Hamburglar -- collect useful information from urls, directories, and files
  ☆319Updated 2 years ago
• si9int / cc.py
  Extracting URLs of a specific target based on the results of "commoncrawl.org"
  ☆272Updated last year
• nethunteros / punter
  Hunt domain names using DNSDumpster, WHOIS, Reverse WHOIS, Shodan, Crimeflare
  ☆297Updated 6 years ago
• woj-ciech / Danger-zone
  Correlate data between domains, IPs and email addresses, present it as a graph and store everything into Elasticsearch and JSON files.
  ☆680Updated 4 years ago
• stamparm / fetch-some-proxies
  Simple Python script for fetching "some" (usable) proxies
  ☆584Updated 2 years ago
• 0x09AL / raven
  raven is a Linkedin information gathering tool that can be used by pentesters to gather information about an organization employees usin…
  ☆788Updated 4 years ago
• rootVIII / proxy_requests
  a class that uses scraped proxies to make http GET/POST requests (Python requests)
  ☆390Updated 4 years ago
• huntrar / scrape
  a command-line web scraping tool
  ☆151Updated last year
• vinta / haul
  An Extensible Image Crawler
  ☆159Updated 8 years ago
• NikolaiT / se-scraper
  Javascript scraping module based on puppeteer for many different search engines...
  ☆559Updated 2 years ago
• cvandeplas / pystemon
  Monitoring tool for PasteBin-alike sites written in Python. Inspired by pastemon http://github.com/xme/pastemon
  ☆335Updated 2 years ago
• woj-ciech / kupa3
  Tracking the trackers. Draw connections between scripts and domains on website.
  ☆14Updated 3 years ago
• CERN-CERT / WAD
  Web application/technology detection tool
  ☆209Updated last year
• aviaryan / python-gsearch
  🔍 Google Search unofficial API for Python with no external dependencies
  ☆217Updated 4 years ago
• pgaref / HTTP_Request_Randomizer
  Proxying Python Requests
  ☆150Updated 3 years ago
• dxa4481 / Snapper
  A security tool for grabbing screenshots of many web hosts
  ☆318Updated 7 years ago
• kahunalu / pwnbin
  Python Pastebin Webcrawler that returns list of public pastebins containing keywords
  ☆434Updated 3 years ago
• flipkart-incubator / RTA
  Red team Arsenal - An intelligent scanner to detect security vulnerabilities in company's layer 7 assets.
  ☆412Updated last year
• kgretzky / dcrawl
  Simple, but smart, multi-threaded web crawler for randomly gathering huge lists of unique domain names.
  ☆529Updated 5 years ago
• eth0izzle / the-endorser
  An OSINT tool that allows you to draw out relationships between people on LinkedIn via endorsements/skills.
  ☆332Updated 2 months ago
• alertot / detectem
  detectem - detect software and its version on websites.
  ☆156Updated 4 years ago
• jcesarstef / python-crawl
  Library to crawl and extract internal links from domain
  ☆27Updated 6 years ago
• s0md3v / Quark
  Quark is a data visualization framework.
  ☆219Updated 4 years ago
• Viralmaniar / Wifi-Dumper
  This is an open source tool to dump the wifi profiles and cleartext passwords of the connected access points on the Windows machine. This…
  ☆282Updated 7 years ago
• NikolaiT / GoogleScraper
  A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
  ☆2,686Updated 3 years ago
• rdegges / brute
  Simple brute forcing in Python.
  ☆104Updated last year
• DanMcInerney / elite-proxy-finder
  Finds public elite anonymity proxies and concurrently tests them
  ☆251Updated 8 years ago
• hannob / snallygaster
  Tool to scan for secret files on HTTP servers
  ☆2,087Updated 3 weeks ago