doitintl / doit-composer-airflow-training
Getting started with Apache Airflow on Cloud Composer
☆29Updated 2 years ago
Alternatives and similar repositories for doit-composer-airflow-training:
Users that are interested in doit-composer-airflow-training are comparing it to the libraries listed below
- CICD pipeline that deploys a dbt image on a GKE cluster☆11Updated 3 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated last year
- ☆12Updated 2 weeks ago
- Source code for the YouTube video, Apache Beam Explained in 12 Minutes☆20Updated 4 years ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆111Updated last year
- This is the code for the Pic-a-daily, an application to upload, analyse and share pictures using Google Cloud serverless solutions, namel…☆79Updated 6 months ago
- Repo with scripts and automation to help ensure best practices in Google Data Catalog☆13Updated 3 years ago
- Demo project for dbt on Databricks☆30Updated 4 years ago
- Fully unit tested utility functions for data engineering. Python 3 only.☆15Updated 5 months ago
- AWS Quick Start Team☆18Updated 4 months ago
- Analytics engineering with dbt - projects and developer environment☆16Updated 4 months ago
- How to Automate SQL: dbt(data build tool) tutorial on bigquery with extensive NOTES☆31Updated last year
- A opensource video stream web app☆25Updated last year
- A Terraform template for provisioning Apache Airflow workflows on AWS ECS Fargate☆14Updated 4 years ago
- ☆13Updated 4 months ago
- Data lake, data warehouse on GCP☆55Updated 3 years ago
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Updated 4 years ago
- ☆30Updated 10 months ago
- ☆28Updated last year
- Materials for the next course☆24Updated 2 years ago
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆65Updated 3 years ago
- ☆34Updated 2 years ago
- ☆36Updated 2 years ago
- ☆14Updated last year
- ☆40Updated this week
- Spark ETL example processing New York taxi rides public dataset on EKS☆44Updated 2 years ago
- ☆18Updated 3 weeks ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆42Updated 2 years ago
- Apache Beam examples for running on Google Cloud Dataflow.☆30Updated 6 years ago
- Getting Great Expectations setup to run on DataBricks with Spark Dataframes.☆13Updated 2 years ago