chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCP
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆23Updated this week
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below
Sorting:
- Cloned by the `dbt init` task☆61Updated last year
- Execution of DBT models using Apache Airflow through Docker Compose☆116Updated 2 years ago
- End-to-end data platform leveraging the Modern data stack☆48Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆68Updated last year
- ☆130Updated 3 months ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 9 months ago
- Code for dbt tutorial☆157Updated 11 months ago
- build dw with dbt☆44Updated 6 months ago
- Code for "Advanced data transformations in SQL" free live workshop☆81Updated last week
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Sample project to demonstrate data engineering best practices☆191Updated last year
- Capstone Project for DataExpert.io V4 Cohort☆10Updated 10 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆42Updated 6 months ago
- End to end data engineering project☆54Updated 2 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- ☆139Updated 2 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆144Updated 4 years ago
- Data Engineering with Databricks Cookbook, published by Packt☆85Updated 11 months ago
- Data engineering with dbt, published by Packt☆77Updated last year
- A curated list of awesome public DBT projects☆128Updated last year
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆141Updated 10 months ago
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆76Updated 11 months ago
- Recohut - Learn data engineering, data science☆97Updated last year
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆35Updated last year
- Code snippets for Data Engineering Design Patterns book☆106Updated last month
- Airflow 3 demos from DevRel☆56Updated this week
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆21Updated last year
- ☆60Updated 3 years ago
- ☆18Updated 9 months ago
- Surfalytics projces on Data Engineering and Analytics☆103Updated this week