scrapinghub / skinfer
Skinfer is a tool for inferring and merging JSON schemas
☆139Updated 11 months ago
Alternatives and similar repositories for skinfer:
Users that are interested in skinfer are comparing it to the libraries listed below
- Modularly extensible semantic metadata validator☆84Updated 9 years ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Updated 5 years ago
- A scrapy extension to store requests and responses information in storage service☆26Updated 3 years ago
- Strongly opinionated python project management.☆38Updated 2 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- Utility library to turn country names into ISO two-letter codes☆66Updated 2 months ago
- Streaming newline delimited JSON I/O.☆12Updated last year
- Faster replacement for Python's urlparse module☆46Updated 6 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆45Updated 4 years ago
- Regular Expression based parsers for extracting data from natural languages☆70Updated 7 years ago
- Find which links on a web page are pagination links☆29Updated 8 years ago
- Automatic Item List Extraction☆87Updated 8 years ago
- Python to Gremlin Graph Abstraction Layer☆55Updated 7 years ago
- Generate SQL tables, load and extract data, based on JSON Table Schema descriptors.☆62Updated last year
- Validation and data pipelines made easy!☆12Updated 5 years ago
- Makes it easy to respect rate limits.☆96Updated 8 years ago
- Fully featured Python feature switch toolkit☆225Updated 3 years ago
- Lightweight data validation and adaptation Python library.☆264Updated 2 years ago
- A tiny library for Python text normalisation. Useful for ad-hoc text processing.☆150Updated 3 months ago
- python library for extracting html microdata☆166Updated last year
- A pandas.DataFrame-based ORM.☆85Updated 3 years ago
- A Python library for finding feed links on websites.☆52Updated 2 years ago
- Agnostic Database Migrations☆53Updated last year
- Sunburnt offspring solr client☆27Updated 3 years ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- Python library to take the pain out of using SaaS APIs. It's like an ORM for SaaS!☆388Updated 5 years ago
- Generate Pandas frames, load and extract data, based on JSON Table Schema descriptors.☆52Updated 3 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated 10 months ago
- Detect and classify pagination links☆15Updated 4 years ago
- Python 3 AsyncIO powered scraping framework with batteries included☆20Updated 8 years ago