Alternatives and similar repositories for spidy

Users that are interested in spidy are comparing it to the libraries listed below

• rootVIII / proxy_requests
  a class that uses scraped proxies to make http GET/POST requests (Python requests)
  ☆390Updated 4 years ago
• huntrar / scrape
  a command-line web scraping tool
  ☆149Updated 2 years ago
• kootenpv / sky
  next generation web crawling using machine intelligence
  ☆331Updated 2 years ago
• s0md3v / goop
  Google Search Scraper
  ☆567Updated 6 years ago
• s0md3v / Quark
  Quark is a data visualization framework.
  ☆221Updated last month
• 0x09AL / raven
  raven is a Linkedin information gathering tool that can be used by pentesters to gather information about an organization employees usin…
  ☆793Updated 5 years ago
• stamparm / fetch-some-proxies
  Simple Python script for fetching "some" (usable) proxies
  ☆584Updated 2 years ago
• nethunteros / punter
  Hunt domain names using DNSDumpster, WHOIS, Reverse WHOIS, Shodan, Crimeflare
  ☆295Updated 6 years ago
• eth0izzle / the-endorser
  An OSINT tool that allows you to draw out relationships between people on LinkedIn via endorsements/skills.
  ☆337Updated 7 months ago
• needmorecowbell / Hamburglar
  Hamburglar -- collect useful information from urls, directories, and files
  ☆319Updated 2 years ago
• DanMcInerney / search-google
  Scrape google search results
  ☆93Updated 7 years ago
• vinta / haul
  An Extensible Image Crawler
  ☆159Updated 8 years ago
• CERN-CERT / WAD
  Web application/technology detection tool
  ☆210Updated 2 years ago
• sangaline / advanced-web-scraping-tutorial
  The Zipru scraper developed in the Advanced Web Scraping Tutorial.
  ☆428Updated 8 years ago
• Buroni / booksoup
  Booksoup allows you to analyse and traverse your downloaded facebook data, including features such as sentiment analysis and message freq…
  ☆125Updated 7 years ago
• aviaryan / python-gsearch
  🔍 Google Search unofficial API for Python with no external dependencies
  ☆215Updated 4 years ago
• woj-ciech / Danger-zone
  Correlate data between domains, IPs and email addresses, present it as a graph and store everything into Elasticsearch and JSON files.
  ☆689Updated 5 years ago
• xdavidhu / portSpider
  🕷 A lightning fast multithreaded network scanner framework with modules.
  ☆324Updated 5 years ago
• pgaref / HTTP_Request_Randomizer
  Proxying Python Requests
  ☆149Updated 3 years ago
• tpeng / googlesearch
  Scrape the Google search result with Scrapy.
  ☆99Updated 5 years ago
• DanMcInerney / elite-proxy-finder
  Finds public elite anonymity proxies and concurrently tests them
  ☆250Updated 8 years ago
• ericfourrier / gimmeproxy-api
  A Python wrapper for the GimmeProxy API (http://gimmeproxy.com/#api)
  ☆10Updated 3 months ago
• michenriksen / birdwatcher
  Data analysis and OSINT framework for Twitter
  ☆410Updated 5 years ago
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated last year
• alertot / detectem
  detectem - detect software and its version on websites.
  ☆157Updated 4 years ago
• anfederico / amazon-alert
  ☆325Updated 8 months ago
• michaelhelmick / lassie
  Web Content Retrieval for Humans™
  ☆623Updated 3 years ago
• woj-ciech / kupa3
  Tracking the trackers. Draw connections between scripts and domains on website.
  ☆17Updated 4 years ago
• d6o / TinderOnline
  Find out which of your friends are online on Tinder
  ☆176Updated 3 years ago
• kahunalu / pwnbin
  Python Pastebin Webcrawler that returns list of public pastebins containing keywords
  ☆433Updated 4 years ago