Alternatives and similar repositories for modCrawler

Users that are interested in modCrawler are comparing it to the libraries listed below

• bigger312 / Sanctions-Lists
  List of Sanctions and Most wanted
  ☆28Updated 8 years ago
• dmahugh / crawlerino
  Simple Python 3 web crawler
  ☆13Updated 5 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated last week
• afilipovich / gglsbl
  Python client library for Google Safe Browsing API
  ☆84Updated 2 years ago
• mattbierner / urban-dictionary-word-list
  Script and sample dataset of all urban dictionary entry names (around 1.4 million total)
  ☆95Updated 3 years ago
• citp / TheWebNeverForgets
  Public code release for The Web Never Forgets paper
  ☆69Updated 4 years ago
• ip2location / ip2proxy-python
  Python library for IP2Proxy database lookup. It can be used to find the IP addresses which are used as VPN anonymizer, open proxies, web…
  ☆36Updated 3 weeks ago
• jpotts18 / stylometry
  A Stylometry Library for Python
  ☆147Updated 2 years ago
• corumir / Practical-Tradecraft
  Resources, articles, thoughts, datasets, papers on TI tradecraft
  ☆11Updated 7 years ago
• blues-lab / polipy
  Library for scraping, parsing, and analyzing privacy policies.
  ☆17Updated 2 years ago
• stamparm / aux
  Auxiliary stuff
  ☆36Updated this week
• dragnet-org / dragnet_data
  code and data used to build a training dataset for dragnet models
  ☆10Updated 5 years ago
• fourthparty / fourthparty
  The FourthParty web measurement platform.
  ☆44Updated 10 years ago
• 9b / frisbee
  Collect email addresses by crawling search engine results.
  ☆30Updated 3 years ago
• citp / email_tracking
  Code and data release for our PETS 2018 paper: "I never signed up for this! Privacy implications of email tracking".
  ☆46Updated 3 years ago
• openwpm / openwpm-crawler
  A crawler that uses OpenWPM.
  ☆12Updated 4 years ago
• isaacimholt / InstagramInfiniteScraper
  OSINT tool for Instagram
  ☆15Updated 6 years ago
• isaacmg / fb_scraper
  FBLYZE is a Facebook scraping system and analysis system.
  ☆67Updated 4 years ago
• plaperdr / fp-central
  A platform to study browser fingerprinting
  ☆73Updated 2 years ago
• lanrat / SpiderWho
  A very fast whois crawler
  ☆40Updated 6 years ago
• bodacea / misinfolinks
  Links to resources on misinformation, disinformation, fake news, whatever it's called this week
  ☆52Updated 3 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated last week
• commoncrawl / cc-downloader
  A polite and user-friendly downloader for Common Crawl data
  ☆67Updated 5 months ago
• soprasteria / cybersecurity-dfm
  Data Feed Manager (news watch orchestrator to predict topic with deepdetect and store cleaned text in elasticsearch)
  ☆40Updated 3 years ago
• webfp / tor-browser-crawler
  A crawler based on Tor Browser and Selenium
  ☆55Updated 4 years ago
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆119Updated last week
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆134Updated last week
• minimaxir / neural-doodle
  Turn your two-bit doodles into fine artworks with deep neural networks, generate seamless textures from photos, transfer style from one i…
  ☆11Updated 9 years ago
• dimalinux / DeviceFingerprint
  Website to view the information fingerprint that your browser exposes to third parties.
  ☆61Updated 7 years ago
• TeamHG-Memex / deep-deep
  Adaptive crawler which uses Reinforcement Learning methods
  ☆168Updated last week