openpreserve / pagelyzer
Suite of tools for detecting changes in web pages and their rendering
☆54Updated last year
Alternatives and similar repositories for pagelyzer:
Users that are interested in pagelyzer are comparing it to the libraries listed below
- Tools for web page segmentation. In development☆17Updated 6 years ago
- A python library detect and extract listing data from HTML page.☆108Updated 7 years ago
- Implementation of Vision Based Page Segmentation algorithm in Java☆101Updated 5 years ago
- Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts☆59Updated 12 years ago
- Site Hound (previously THH) is a Domain Discovery Tool☆23Updated 3 years ago
- Web page segmentation and noise removal☆55Updated last year
- ☆32Updated last year
- Pipeline for distributed Natural Language Processing, made in Python☆65Updated 8 years ago
- Aviation grade news article metadata extraction☆36Updated last year
- Common Crawl Index Server☆66Updated last week
- ImageCat is an Apache OODT RADIX application that uses Apache Solr, Apache Tika and Apache OODT to ingest 10s of millions of files (image…☆95Updated 6 years ago
- WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…☆48Updated 3 years ago
- Word analysis, by domain, on the Common Crawl data set for the purpose of finding industry trends☆56Updated last year
- General Architecture for Text Engineering☆48Updated 8 years ago
- A toolkit for clustering web pages based on various similarity measures.☆33Updated 3 years ago
- D3 and Play based visualization for entity-relation graphs, especially for NLP and information extraction☆29Updated 9 years ago
- The WikiBrain Java library enables researchers and developers to incorporate state-of-the-art Wikipedia-based algorithms and technologies…☆91Updated 6 years ago
- extract difference between two html pages☆32Updated 6 years ago
- Tools for iterative knowledge base development with DeepDive☆119Updated 6 years ago
- Virtual patent marking crawler at iproduct.epfl.ch☆14Updated 7 years ago
- Adaptive crawler which uses Reinforcement Learning methods☆170Updated 6 years ago
- Paginating the web☆37Updated 11 years ago
- A simple viewer and inspection tool for text boxes in PDF documents☆95Updated 3 years ago
- gzipstream allows Python to process multi-part gzip files from a streaming source☆23Updated 8 years ago
- Semanticizest: dump parser and client☆20Updated 8 years ago
- Distributed text analysis suite based on Celery☆95Updated 2 years ago
- A simple algorithm for clustering web pages, suitable for crawlers☆34Updated 8 years ago
- The YQL+ parser, execution engine, and source SDK.☆41Updated last year
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆56Updated 3 years ago
- Structured Data Extractor. An application to extract structured data from web pages. It uses Data Extraction Based on Partial Tree Alignm…☆49Updated 12 years ago