matiskay / html-clusterLinks
A command line tool to cluster html pages based on structural and style similarity.
☆20Updated last month
Alternatives and similar repositories for html-cluster
Users that are interested in html-cluster are comparing it to the libraries listed below
Sorting:
- A generic crawler☆78Updated 7 years ago
- Now included in rigour☆152Updated last month
- API client for Aleph, supports bulk entity and document upload.☆29Updated last year
- ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of diff…☆89Updated 3 years ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- A browser user interface for manual labeling of record pairs.☆48Updated 2 years ago
- extract difference between two html pages☆32Updated 3 weeks ago
- ☆59Updated 4 years ago
- Build intelligent data-driven applications with minimal effort. Sentence Clustering, Topics Extraction, Text Similarity, Opinion Summariz…☆41Updated 6 years ago
- Classifying the content of domains☆58Updated 3 months ago
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆58Updated last year
- Predict age and gender from a first name☆59Updated 7 years ago
- Extract text from HTML☆135Updated 5 years ago
- API - extract a list of keywords from a text.☆18Updated 8 years ago
- Broad crawler for domain discovery☆19Updated 7 years ago
- Homoglyphs: get similar letters, convert to ASCII, detect possible languages and UTF-8 group.☆84Updated 4 years ago
- Ensemble topic modeling with matrix factorization☆24Updated 7 years ago
- Scrape the Google search result with Scrapy.☆99Updated 5 years ago
- Record Linkage ToolKit (Find and link entities)☆111Updated 2 years ago
- A toolkit for clustering web pages based on various similarity measures.☆34Updated 4 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Updated last year
- Scraper for Facebook's Archive of Ads with Political Content☆37Updated 7 years ago
- A helper library full of URL-related heuristics.☆73Updated 3 months ago
- Simple duckduckgo results scraping☆68Updated 8 years ago
- ☆35Updated 2 years ago
- Find strings/words in text; convenience and C speed☆126Updated 3 years ago
- OSoMe API mashups☆11Updated 6 years ago
- Analyze scraped data☆46Updated 6 years ago
- A component that tries to avoid downloading duplicate content☆27Updated 7 years ago