scrapinghub / skinfer
Skinfer is a tool for inferring and merging JSON schemas
☆139Updated 9 months ago
Alternatives and similar repositories for skinfer:
Users that are interested in skinfer are comparing it to the libraries listed below
- Modularly extensible semantic metadata validator☆83Updated 9 years ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Updated 5 years ago
- A scrapy extension to store requests and responses information in storage service☆26Updated 2 years ago
- Transform flat data structures into nested object graphs matching JSON schema definitions.☆28Updated 8 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated 8 months ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Updated 3 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- A python library detect and extract listing data from HTML page.☆109Updated 7 years ago
- Python 3 AsyncIO powered scraping framework with batteries included☆20Updated 8 years ago
- Versioned domain model. Python library for revisioning/versioning of databases.☆44Updated 4 years ago
- Strongly opinionated python project management.☆38Updated 2 years ago
- Generate Pandas frames, load and extract data, based on JSON Table Schema descriptors.☆52Updated 3 years ago
- New grammar for SQLAlchemy to handle the crosstab() tablefunc in Postgresql.☆43Updated 6 years ago
- Paginating the web☆37Updated 10 years ago
- pyaddress is an address parsing library, taking the guesswork out of using addresses in your applications. We use it as part of our apart…☆100Updated 5 years ago
- Scrapy spider middleware to clean up query parameters in request URLs☆25Updated 8 years ago
- Makes it easy to respect rate limits.☆96Updated 8 years ago
- Faster replacement for Python's urlparse module☆46Updated 6 years ago
- Python library for class-based schema definition, object serialization and data validation☆62Updated 9 years ago
- python library for extracting html microdata☆166Updated last year
- Python implementation of URI Template☆78Updated 6 years ago
- Flask-RAML (REST API Markup Language) API server with parameter conversion, response encoding, and examples.☆47Updated 3 years ago
- Python library for Hoverfly (now obsolete)☆79Updated last year
- Dedupe/batch geocode addresses and venues around the world with libpostal☆81Updated 3 years ago
- Scrapy middleware which allows to crawl only new content☆80Updated 2 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Programmatic building of JSON schemas (document and field mappings) with validation.☆31Updated 3 years ago
- Detect and classify pagination links☆100Updated 4 years ago
- Generate SQL tables, load and extract data, based on JSON Table Schema descriptors.☆62Updated last year