andrewgross / json2parquet
Convert JSON files to Parquet using PyArrow
☆94Updated 10 months ago
Related projects ⓘ
Alternatives and complementary repositories for json2parquet
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆116Updated last year
- PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).☆95Updated last year
- [ARCHIVED] The Presto adapter plugin for dbt Core☆33Updated 11 months ago
- Airflow declarative DAGs via YAML☆131Updated last year
- Airflow workflow management platform chef cookbook.☆68Updated 5 years ago
- ☆27Updated this week
- Pylint plugin for static code analysis on Airflow code☆90Updated 4 years ago
- Amundsen Gremlin☆20Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆193Updated 5 months ago
- Presto-like CLI tool for AWS Athena☆85Updated 2 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- A collection of airflow sample workflows for data processing on aws☆12Updated 6 years ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated last year
- DBT Cloud Plugin for Airflow☆38Updated 6 months ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆262Updated last year
- ☆127Updated 4 years ago
- REST-like API exposing Airflow data and operations☆61Updated 5 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 6 years ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated last year
- Python Driver for Apache Drill.☆59Updated last year
- Performant Redshift data source for Apache Spark☆136Updated 3 months ago
- SQL data model for working with Snowplow web data. Supports Redshift and Looker. Snowflake and BigQuery coming soon☆61Updated 3 years ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆78Updated last week
- A Getting Started Guide for developing and using Airflow Plugins☆94Updated 6 years ago
- Turbine: the bare metals that gets you Airflow☆377Updated 3 years ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆70Updated 2 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 5 years ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆60Updated last year
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year