Alternatives and similar repositories for html-cluster:

Users that are interested in html-cluster are comparing it to the libraries listed below

• TeamHG-Memex / page-compare
  Simple heuristic for measuring web page similarity (& data set)
  ☆90Updated 6 years ago
• matiskay / html-similarity
  Compare html similarity using structural and style metrics
  ☆210Updated last year
• daremon / urlclustering
  Package to facilitate URL clustering
  ☆67Updated 9 years ago
• scrapinghub / autoextract-spiders
  Pre-built Scrapy spiders for AutoExtract
  ☆19Updated 11 months ago
• TeamHG-Memex / extract-html-diff
  extract difference between two html pages
  ☆32Updated 6 years ago
• TeamHG-Memex / url-summary
  Show summary of a large number of URLs in a Jupyter Notebook
  ☆17Updated 3 years ago
• TeamHG-Memex / undercrawler
  A generic crawler
  ☆78Updated 6 years ago
• scrapy-plugins / scrapy-headless
  ☆29Updated 3 years ago
• JasonKessler / agefromname
  Predict age and gender from a first name
  ☆60Updated 6 years ago
• justinlittman / twitter-scraper
  A tool for scraping tweet ids from the Twitter website.
  ☆32Updated 8 years ago
• TeamHG-Memex / domain-discovery-crawler
  Broad crawler for domain discovery
  ☆19Updated 6 years ago
• TeamHG-Memex / autopager
  Detect and classify pagination links
  ☆102Updated 4 years ago
• alephdata / alephclient
  API client for Aleph, supports bulk entity and document upload.
  ☆28Updated 5 months ago
• scrapinghub / autopager
  Detect and classify pagination links
  ☆15Updated 4 years ago
• scrapy / xtractmime
  https://mimesniff.spec.whatwg.org/ implementation for Python
  ☆13Updated last year
• TeamHG-Memex / MaybeDont
  A component that tries to avoid downloading duplicate content
  ☆27Updated 6 years ago
• scrapy-plugins / scrapy-jsonschema
  Scrapy schema validation pipeline and Item builder using JSON Schema
  ☆45Updated 4 years ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆134Updated 4 years ago
• datawizard1337 / ARGUS
  ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of diff…
  ☆88Updated 3 years ago
• scrapinghub / page_clustering
  A simple algorithm for clustering web pages, suitable for crawlers
  ☆34Updated 8 years ago
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆41Updated 5 years ago
• RxNLP / PyRXNLP
  Build intelligent data-driven applications with minimal effort. Sentence Clustering, Topics Extraction, Text Similarity, Opinion Summariz…
  ☆40Updated 5 years ago
• burrsettles / readability
  Text readability metrics in Python.
  ☆11Updated 11 years ago
• TeamHG-Memex / scrapy-kafka-export
  Scrapy extension which writes crawled items to Kafka
  ☆30Updated 6 years ago
• rmdort / spellchecker
  Spell correct entire sentences using nltk freqdist and symspell
  ☆19Updated 7 years ago
• scrapinghub / scrapy-autoextract
  Zyte Automatic Extraction integration for Scrapy
  ☆56Updated 3 years ago
• opensanctions / fingerprints
  Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.
  ☆149Updated 2 months ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 8 years ago
• scrapinghub / arche
  Analyze scraped data
  ☆46Updated 5 years ago
• CI-Research / KeywordAnalysis
  Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends
  ☆56Updated last year