mrafayaleem / etl-series
☆12Updated 3 years ago
Related projects: ⓘ
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆52Updated 4 years ago
- Pylint plugin for static code analysis on Airflow code☆89Updated 3 years ago
- rb_status_plugin : Data confidence tool for Airflow☆12Updated last year
- ☆15Updated this week
- ☆11Updated 4 years ago
- Utility functions for dbt projects running on Spark☆30Updated 10 months ago
- Rules based grant management for Snowflake☆40Updated 5 years ago
- How to deploy airflow on Kubernetes☆38Updated last year
- Sample Airflow DAGs☆60Updated last year
- Airflow training for the crunch conf☆105Updated 5 years ago
- ☆18Updated 4 years ago
- Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes maste…☆22Updated 2 years ago
- Enforce Best Practices for all your Airflow DAGs. ⭐☆86Updated this week
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆81Updated 4 months ago
- ☆11Updated this week
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 2 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆22Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆71Updated last year
- 🐋 Docker image for AWS Glue Spark/Python☆22Updated last year
- Code to be contributed to the Apache Airflow (incubating) project for ETL workflow management for integrating with the Snowflake Data War…☆25Updated 7 years ago
- DBT Cloud Plugin for Airflow☆38Updated 4 months ago
- Astronomer Core Docker Images☆106Updated 3 months ago
- A Python API for Asynchronously Loading Data into Snowflake DB -☆59Updated last week
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆135Updated this week
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆167Updated 10 months ago
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 4 years ago
- Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker…☆84Updated last year
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆104Updated last week