matiskay / html-clusterLinks
A command line tool to cluster html pages based on structural and style similarity.
☆20Updated 3 weeks ago
Alternatives and similar repositories for html-cluster
Users that are interested in html-cluster are comparing it to the libraries listed below
Sorting:
- Simple heuristic for measuring web page similarity (& data set)☆91Updated 7 years ago
- Compare html similarity using structural and style metrics☆213Updated 2 years ago
- A generic crawler☆78Updated 7 years ago
- Broad crawler for domain discovery☆19Updated 7 years ago
- A complimentary proxy to help to use SPM with headless browsers☆108Updated 2 years ago
- ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of diff…☆88Updated 3 years ago
- extract difference between two html pages☆32Updated 7 years ago
- ☆29Updated 4 years ago
- Now included in rigour☆151Updated last week
- API client for Aleph, supports bulk entity and document upload.☆28Updated 9 months ago
- Record Linkage ToolKit (Find and link entities)☆110Updated last year
- Detect and classify pagination links☆103Updated 4 years ago
- Scrapy middleware for the autologin☆36Updated 7 years ago
- Extract text from HTML☆134Updated 5 years ago
- Formasaurus tells you the type of an HTML form and its fields using machine learning☆119Updated last year
- A component that tries to avoid downloading duplicate content☆27Updated 7 years ago
- OSoMe API mashups☆11Updated 6 years ago
- A python library detect and extract listing data from HTML page.☆108Updated 8 years ago
- ☆35Updated last year
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆57Updated last year
- The CorpWatch API uses automated parsers to extract the subsidiary relationship information from Exhibit 21 of companies' 10-K filings wi…☆48Updated 6 months ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 5 years ago
- Package to facilitate URL clustering☆69Updated 9 years ago
- Scraping Tweet data for Russian Troll Twitter accounts into Neo4j☆57Updated 7 years ago
- Pre-built Scrapy spiders for AutoExtract☆19Updated last year
- An automated, programming-free web scraper for interactive sites☆111Updated 2 years ago
- A twitter streaming library built on tweepy that enables dynamic term tracking☆51Updated 4 years ago
- Spell correct entire sentences using nltk freqdist and symspell☆19Updated 8 years ago
- Scrape the Google search result with Scrapy.☆99Updated 5 years ago
- A toolkit for clustering web pages based on various similarity measures.☆33Updated 3 years ago