nudge / schemaLinks
A Python implementation of SCHEMA - An Algorithm for Automated Product Taxonomy Mapping in E-commerce.
☆16Updated 11 years ago
Alternatives and similar repositories for schema
Users that are interested in schema are comparing it to the libraries listed below
Sorting:
- Restrict crawl and scraping scope using matchers.☆26Updated 9 years ago
- Small set of utilities to simplify writing Scrapy spiders.☆49Updated 10 years ago
- E-commerce scraping and analytics platform.☆52Updated 10 years ago
- Scrapy middleware for the autologin☆36Updated 2 weeks ago
- A component that tries to avoid downloading duplicate content☆27Updated 2 weeks ago
- Site Hound (previously THH) is a Domain Discovery Tool☆23Updated 2 weeks ago
- Proxy-list management application for Django☆23Updated 7 years ago
- Easy extraction of keywords and engines from search engine results pages (SERPs).☆93Updated 3 months ago
- A python library detect and extract listing data from HTML page.☆108Updated 8 years ago
- Resize image on the fly using flask, zappa, pillow, opencv-python☆18Updated 8 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated last year
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 8 years ago
- A history mixin with audit logging, record locking, and time travel for FlaskSQLAlchemy☆19Updated 11 months ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Updated 4 years ago
- A helper to create web scrapers using scrapy selector in a Model based structure☆57Updated 3 years ago
- Find which links on a web page are pagination links☆29Updated 9 years ago
- Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even whe…☆55Updated last year
- Passwordless Email Auth☆27Updated 3 years ago
- Scrapy downloader middleware that stores response HTMLs to disk.☆18Updated 3 weeks ago
- 📑⚙️ Python/Django reference implementation of the ERAV data model☆21Updated 6 years ago
- Python client library for SeatGeek's Sixpack A/B testing framework☆40Updated 3 years ago
- Paginating the web☆37Updated 11 years ago
- Formasaurus tells you the type of an HTML form and its fields using machine learning☆119Updated 2 weeks ago
- REST API for Text Summarization and Keywords Extraction☆16Updated 3 years ago
- Detect and classify pagination links☆15Updated 5 years ago
- Matches a category of Google's Taxonomy to product that is described in any kind of text data☆63Updated 7 years ago
- Scrapy middleware which allows to crawl only new content☆79Updated 2 weeks ago
- 🕷Configuration based html scraper☆23Updated 3 months ago
- a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine☆97Updated last year
- An advanced yet simple system to run your background tasks and workflows☆19Updated 8 years ago