scrapinghub / skinfer
Skinfer is a tool for inferring and merging JSON schemas
☆141Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for skinfer
- Modularly extensible semantic metadata validator☆83Updated 8 years ago
- Tool to flatten stream of JSON-like objects, configured via schema☆33Updated 5 years ago
- Restrict crawl and scraping scope using matchers.☆25Updated 8 years ago
- A scrapy extension to store requests and responses information in storage service☆26Updated 2 years ago
- python library for extracting html microdata☆165Updated last year
- Paginating the web☆37Updated 10 years ago
- Streaming newline delimited JSON I/O.☆12Updated last year
- A python library detect and extract listing data from HTML page.☆109Updated 7 years ago
- Parse, normalize and render postal addresses.☆181Updated last year
- Street address parser and formatter☆92Updated 5 years ago
- Scrapy schema validation pipeline and Item builder using JSON Schema☆44Updated 3 years ago
- Analyze scraped data☆47Updated 4 years ago
- Data analysis and reporting tool for quick access to custom charts and tables in Jupyter Notebooks and in the shell.☆119Updated 9 months ago
- Python implementation of the Parsley language for extracting structured data from web pages☆92Updated 7 years ago
- Snowplow event tracker for Python. Add analytics to your Python and Django apps, webapps and games☆43Updated 2 months ago
- Python SDK for working with Snowplow enriched events in Spark, AWS Lambda et al.☆21Updated last year
- Python binding for gumbo-parser using Cython☆14Updated 8 years ago
- Find which links on a web page are pagination links☆29Updated 7 years ago
- New grammar for SQLAlchemy to handle the crosstab() tablefunc in Postgresql.☆43Updated 6 years ago
- Detect and classify pagination links☆14Updated 4 years ago
- An extended version of the official Elasticsearch Python client.☆63Updated 9 years ago
- Utils around luigi.☆65Updated 3 years ago
- Store and replay HTTP requests made in your Python app☆138Updated last year
- Detect and classify pagination links☆98Updated 4 years ago
- xmldataset: xml parsing made easy 🗃️☆77Updated 4 years ago
- [UNMAINTAINED] Deploy, run and monitor your Scrapy spiders.☆11Updated 9 years ago
- Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations☆40Updated 5 months ago
- Generate SQL tables, load and extract data, based on JSON Table Schema descriptors.☆61Updated last year
- A postgresql dialect based on psycopg2 adding support for Foreign Data Wrappers☆22Updated last year
- Amazon Redshift SQLAlchemy Dialect☆48Updated 8 years ago