Alternatives and similar repositories for modCrawler

Users that are interested in modCrawler are comparing it to the libraries listed below

• uiowa-irl / FP-Inspector
  Artifact release for our IEEE Symposium on Security and Privacy 2021 paper entitled Fingerprinting the Fingerprinters: Learning to Detect…
  ☆71Updated 4 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 7 years ago
• bigger312 / Sanctions-Lists
  List of Sanctions and Most wanted
  ☆29Updated 8 years ago
• scrapinghub / adblockparser
  Python parser for Adblock Plus filters
  ☆199Updated 6 years ago
• TeamHG-Memex / page-compare
  Simple heuristic for measuring web page similarity (& data set)
  ☆91Updated 7 years ago
• ip2location / ip2proxy-python
  Python library for IP2Proxy database lookup. It can be used to find the IP addresses which are used as VPN anonymizer, open proxies, web…
  ☆36Updated 3 weeks ago
• alephdata / alephclient
  API client for Aleph, supports bulk entity and document upload.
  ☆28Updated last year
• citp / TheWebNeverForgets
  Public code release for The Web Never Forgets paper
  ☆68Updated 3 years ago
• isaacmg / fb_scraper
  FBLYZE is a Facebook scraping system and analysis system.
  ☆65Updated 4 years ago
• TeamHG-Memex / url-summary
  Show summary of a large number of URLs in a Jupyter Notebook
  ☆17Updated 4 years ago
• TeamHG-Memex / sitehound-frontend
  Site Hound (previously THH) is a Domain Discovery Tool
  ☆23Updated 4 years ago
• englehardt / cookies-that-give-you-away
  Code release for: Cookies that give you away: The surveillance implications of web tracking
  ☆53Updated 6 years ago
• plaperdr / fp-central
  A platform to study browser fingerprinting
  ☆72Updated 2 years ago
• dmahugh / crawlerino
  Simple Python 3 web crawler
  ☆13Updated 5 years ago
• mozilla / trackingprotection-tools
  A collection of tools for working with and analyzing Tracking Protection as implemented in Firefox
  ☆19Updated 2 years ago
• corumir / Practical-Tradecraft
  Resources, articles, thoughts, datasets, papers on TI tradecraft
  ☆11Updated 7 years ago
• johnbumgarner / newshound
  This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…
  ☆33Updated 2 years ago
• jingconan / SADIT
  Statitical Anomaly Detector of Internet Traffic (SADIT)
  ☆22Updated 8 years ago
• marcopoli / Identification-of-Twitter-bots-using-CNN
  Python project to create a classifier to guess if a Twitter account is a man, a woman or a bot.
  ☆18Updated 6 years ago
• citp / email_tracking
  Code and data release for our PETS 2018 paper: "I never signed up for this! Privacy implications of email tracking".
  ☆46Updated 3 years ago
• stamparm / aux
  Auxiliary stuff
  ☆35Updated last week
• commoncrawl / cc-downloader
  A polite and user-friendly downloader for Common Crawl data
  ☆59Updated 3 months ago
• CIRCL / carl-hauser
  Open Source testing framework for image correlation, distance and analysis
  ☆44Updated 2 years ago
• Leo675 / hma-scraper
  Scrapes the obfuscated proxy list at proxylist.hidemyass.com
  ☆32Updated 6 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆46Updated 7 years ago
• fourthparty / fourthparty
  The FourthParty web measurement platform.
  ☆44Updated 10 years ago
• blues-lab / polipy
  Library for scraping, parsing, and analyzing privacy policies.
  ☆17Updated 2 years ago
• DanMcInerney / search-google
  Scrape google search results
  ☆93Updated 7 years ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 7 years ago
• afilipovich / gglsbl
  Python client library for Google Safe Browsing API
  ☆84Updated 2 years ago