Alternatives and similar repositories for spidy:

Users that are interested in spidy are comparing it to the libraries listed below

• 0x09AL / raven
  raven is a Linkedin information gathering tool that can be used by pentesters to gather information about an organization employees usin…
  ☆783Updated 4 years ago
• eth0izzle / the-endorser
  An OSINT tool that allows you to draw out relationships between people on LinkedIn via endorsements/skills.
  ☆328Updated 3 years ago
• woj-ciech / Danger-zone
  Correlate data between domains, IPs and email addresses, present it as a graph and store everything into Elasticsearch and JSON files.
  ☆678Updated 4 years ago
• si9int / cc.py
  Extracting URLs of a specific target based on the results of "commoncrawl.org"
  ☆271Updated last year
• TeamHG-Memex / autologin
  A project to attempt to automatically login to a website given a single seed
  ☆123Updated 2 years ago
• needmorecowbell / Hamburglar
  Hamburglar -- collect useful information from urls, directories, and files
  ☆317Updated 2 years ago
• s0md3v / goop
  Google Search Scraper
  ☆565Updated 5 years ago
• kootenpv / sky
  next generation web crawling using machine intelligence
  ☆331Updated last year
• rootVIII / proxy_requests
  a class that uses scraped proxies to make http GET/POST requests (Python requests)
  ☆388Updated 4 years ago
• kahunalu / pwnbin
  Python Pastebin Webcrawler that returns list of public pastebins containing keywords
  ☆430Updated 3 years ago
• batuhaniskr / twitter-intelligence
  Twitter Intelligence OSINT project performs tracking and analysis of the Twitter
  ☆239Updated 4 years ago
• michaelhelmick / lassie
  Web Content Retrieval for Humans™
  ☆616Updated 2 years ago
• michenriksen / birdwatcher
  Data analysis and OSINT framework for Twitter
  ☆412Updated 4 years ago
• s0md3v / Quark
  Quark is a data visualization framework.
  ☆217Updated 4 years ago
• needmorecowbell / sniff-paste
  Pastebin OSINT Harvester
  ☆321Updated 5 years ago
• sangaline / advanced-web-scraping-tutorial
  The Zipru scraper developed in the Advanced Web Scraping Tutorial.
  ☆429Updated 7 years ago
• huntrar / scrape
  a command-line web scraping tool
  ☆151Updated last year
• alertot / detectem
  detectem - detect software and its version on websites.
  ☆154Updated 3 years ago
• rajeshmajumdar / PloitKit
  The Hacker's ToolBox
  ☆184Updated 7 years ago
• scrapy / scrapely
  A pure-python HTML screen-scraping library
  ☆1,870Updated 2 years ago
• tonywangcn / scaleable-crawler-with-docker-cluster
  a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine
  ☆97Updated 10 months ago
• woj-ciech / kupa3
  Tracking the trackers. Draw connections between scripts and domains on website.
  ☆15Updated 3 years ago
• NikolaiT / se-scraper
  Javascript scraping module based on puppeteer for many different search engines...
  ☆553Updated 2 years ago
• Buroni / booksoup
  Booksoup allows you to analyse and traverse your downloaded facebook data, including features such as sentiment analysis and message freq…
  ☆125Updated 6 years ago
• vinta / haul
  An Extensible Image Crawler
  ☆159Updated 8 years ago
• hkm / whoishere.py
  WIFI Client Detection - Identify people by assigning a name to a device performing a wireless probe request.
  ☆228Updated 4 years ago
• scrapinghub / scrapyrt
  HTTP API for Scrapy spiders
  ☆849Updated 7 months ago
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆118Updated 8 months ago
• johackim / docker-hacklab
  My personal hacklab, create your own.
  ☆335Updated 2 years ago
• stamparm / fetch-some-proxies
  Simple Python script for fetching "some" (usable) proxies
  ☆582Updated last year