Alternatives and similar repositories for urlclustering

Users that are interested in urlclustering are comparing it to the libraries listed below

• TeamHG-Memex / page-compare
  Simple heuristic for measuring web page similarity (& data set)
  ☆90Updated 7 years ago
• grrrrrrrrr / hyperscan-python
  Simple Python bindings for the Hyperscan project.
  ☆20Updated 8 years ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 7 years ago
• scrapinghub / wappalyzer-python
  UNMAINTAINED Python wrapper for Wappalyzer (utility that uncovers the technologies used on websites)
  ☆82Updated 8 years ago
• wallarm / libdetection
  Signature-free approach library to detect injection and commanding attacks
  ☆94Updated 3 years ago
• adamkusey / securitai-lstm-model
  ☆62Updated 7 years ago
• uber / py-find-injection
  Look for SQL injection attacks in python source code
  ☆129Updated 6 years ago
• dbrandt / proc_events
  Access the process event connector in linux kernels from Python.
  ☆28Updated 3 years ago
• TeamHG-Memex / url-summary
  Show summary of a large number of URLs in a Jupyter Notebook
  ☆17Updated 4 years ago
• matiskay / html-similarity
  Compare html similarity using structural and style metrics
  ☆212Updated 2 years ago
• TeamHG-Memex / soft404
  A classifier for detecting soft 404 pages
  ☆56Updated last year
• devhub / domaintools
  Domain parsing with Python
  ☆44Updated 3 months ago
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 7 years ago
• flabbergastedbd / nightfury
  ☆33Updated 8 years ago
• scrapinghub / python-simhash
  An efficient simhash implementation for python
  ☆125Updated 5 years ago
• dashaub / espandas
  Reading and writing pandas DataFrames in Elasticsearch
  ☆25Updated 4 years ago
• rishy / phishing-websites
  Identifies phishing websites using a treebag model
  ☆22Updated 4 years ago
• 360netlab / flint
  The python client of passivedns.cn
  ☆97Updated 6 years ago
• skskevin / UrlDetect
  ☆32Updated 5 years ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 7 years ago
• aarora79 / dns2vec
  Exploring internet domain names with deep learning using vector embeddings
  ☆20Updated 6 years ago
• matiskay / html-cluster
  A command line tool to cluster html pages based on structural and style similarity.
  ☆20Updated 2 weeks ago
• scrapinghub / aile
  Automatic Item List Extraction
  ☆87Updated 9 years ago
• axiak / pyre2
  Python wrapper for RE2
  ☆297Updated 2 years ago
• h2oai / app-malicious-domains
  Domain name classifier looking for good vs. possibly malicious providers
  ☆33Updated 7 years ago
• scrapinghub / page_clustering
  A simple algorithm for clustering web pages, suitable for crawlers
  ☆34Updated 8 years ago
• barseghyanartur / tld
  Extracts the top level domain (TLD) from the URL given.
  ☆182Updated last month
• brianwrf / HackRequests
  It is a dedicated requests lib that supports cookie, headers, get/post, etc. And it also supports rendering the response (e.g. Javascript…
  ☆85Updated 7 years ago
• h-j-13 / Malicious_Domain_Whois
  非法域名挖掘与画像系统
  ☆80Updated 7 years ago
• seomoz / pyreBloom
  Fast Redis Bloom Filters in Python
  ☆290Updated 6 years ago