Alternatives and similar repositories for modCrawler

Users that are interested in modCrawler are comparing it to the libraries listed below

• uiowa-irl / FP-Inspector
  Artifact release for our IEEE Symposium on Security and Privacy 2021 paper entitled Fingerprinting the Fingerprinters: Learning to Detect…
  ☆71Updated 4 years ago
• dmahugh / crawlerino
  Simple Python 3 web crawler
  ☆13Updated 5 years ago
• scrapinghub / adblockparser
  Python parser for Adblock Plus filters
  ☆200Updated 6 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated last week
• afilipovich / gglsbl
  Python client library for Google Safe Browsing API
  ☆84Updated 2 years ago
• TeamHG-Memex / url-summary
  Show summary of a large number of URLs in a Jupyter Notebook
  ☆17Updated last week
• blues-lab / polipy
  Library for scraping, parsing, and analyzing privacy policies.
  ☆17Updated 2 years ago
• bigger312 / Sanctions-Lists
  List of Sanctions and Most wanted
  ☆28Updated 8 years ago
• johnbumgarner / newshound
  This Python package can be used to systematically extract multiple data elements (e.g., title, keywords, text) from news sources around t…
  ☆33Updated 2 years ago
• openwpm / openwpm-crawler
  A crawler that uses OpenWPM.
  ☆12Updated 4 years ago
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆104Updated last week
• dragnet-org / dragnet_data
  code and data used to build a training dataset for dragnet models
  ☆10Updated 5 years ago
• maastrichtlawtech / VendorLink
  🌐 Identifying & Linking Vendor Migrants and Aliases on Darknet Markets. (ACL 2023)
  ☆22Updated 2 years ago
• privacy-tech-lab / privacy-pioneer
  Privacy browser extension for analyzing web traffic of visited websites
  ☆31Updated this week
• tb0hdan / idun
  DomainsProject.org HTTP worker
  ☆24Updated 3 years ago
• citp / email_tracking
  Code and data release for our PETS 2018 paper: "I never signed up for this! Privacy implications of email tracking".
  ☆46Updated 3 years ago
• ilinguistics / common_crawl_corpus
  Scripts for building a geo-located web corpus using Common Crawl data
  ☆11Updated last month
• kostassolo / dangers-of-human-touch
  Repository for the defense mechanism of the paper "The Dangers of Human Touch: Fingerprinting Browser Extensions through User Actions"
  ☆10Updated 3 years ago
• mattbierner / urban-dictionary-word-list
  Script and sample dataset of all urban dictionary entry names (around 1.4 million total)
  ☆95Updated 3 years ago
• thibauts / duckduckgo
  Simple duckduckgo results scraping
  ☆68Updated 8 years ago
• stamparm / aux
  Auxiliary stuff
  ☆36Updated this week
• TeamHG-Memex / soft404
  A classifier for detecting soft 404 pages
  ☆57Updated last week
• tadatitam / info-flow-experiments
  Run information flow experiments on the Web
  ☆39Updated 4 years ago
• TeamHG-Memex / Formasaurus
  Formasaurus tells you the type of an HTML form and its fields using machine learning
  ☆119Updated last week
• soprasteria / cybersecurity-dfm
  Data Feed Manager (news watch orchestrator to predict topic with deepdetect and store cleaned text in elasticsearch)
  ☆40Updated 3 years ago
• ikreymer / webarchive-indexing
  Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.
  ☆47Updated 8 years ago
• plaperdr / fp-central
  A platform to study browser fingerprinting
  ☆73Updated 2 years ago
• ail-project / ail-feeder-twitter
  External twitter feeder for AIL framework
  ☆16Updated 2 years ago
• CIRCL / carl-hauser
  Open Source testing framework for image correlation, distance and analysis
  ☆44Updated 2 years ago
• bloomberg / fast-noise-aware-topic-clustering
  Research code and scripts used in the Silburt et al. (2021) EMNLP 2021 paper 'FANATIC: FAst Noise-Aware TopIc Clustering'
  ☆11Updated 2 years ago