andrewgross / json2parquet
Convert JSON files to Parquet using PyArrow
☆94Updated 8 months ago
Related projects: ⓘ
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆116Updated last year
- PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).☆95Updated last year
- Presto-like CLI tool for AWS Athena☆85Updated last year
- A Getting Started Guide for developing and using Airflow Plugins☆94Updated 5 years ago
- Pylint plugin for static code analysis on Airflow code☆89Updated 3 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆262Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 5 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆104Updated last week
- Python Driver for Apache Drill.☆59Updated last year
- [ARCHIVED] The Presto adapter plugin for dbt Core☆33Updated 9 months ago
- REST-like API exposing Airflow data and operations☆61Updated 5 years ago
- Airflow workflow management platform chef cookbook.☆67Updated 5 years ago
- Airflow declarative DAGs via YAML☆131Updated last year
- Cloudformation templates for deploying Airflow in ECS☆40Updated 5 years ago
- Amazon Redshift SQLAlchemy Dialect☆219Updated 2 months ago
- A Python client for Apache Livy, enabling use of remote Apache Spark clusters.☆70Updated 2 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- Airflow plugin to transfer arbitrary files between operators☆78Updated 5 years ago
- ETLy is an add-on dashboard service on top of Apache Airflow.☆69Updated last year
- afctl helps to manage and deploy Apache Airflow projects faster and smoother.☆130Updated 2 years ago
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆86Updated last year
- Example for an airflow plugin☆49Updated 8 years ago
- A collection of airflow sample workflows for data processing on aws☆12Updated 6 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆192Updated 3 months ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated 11 months ago
- pytest plugin to run the tests with support of pyspark☆84Updated 6 months ago
- Multiple node presto cluster on docker container☆120Updated 2 years ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆76Updated this week
- Airflow Backfill UI based plugin for existing / new Airflow environment☆66Updated 3 years ago
- Low level, multiprocessing based AWS Kinesis producer & consumer library☆117Updated 4 months ago