chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCPLinks
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆23Updated this week
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below
Sorting:
- build dw with dbt☆45Updated 7 months ago
- End-to-end data platform leveraging the Modern data stack☆48Updated last year
- Code for dbt tutorial☆157Updated last year
- Cloned by the `dbt init` task☆61Updated last year
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆140Updated 10 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆42Updated 6 months ago
- Data engineering with dbt, published by Packt☆78Updated last year
- End to end data engineering project☆56Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆116Updated 2 months ago
- Template for Data Engineering and Data Pipeline projects☆112Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- ☆40Updated 11 months ago
- ☆87Updated 5 months ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆83Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆69Updated last year
- ☆132Updated 3 months ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆176Updated 3 years ago
- Delta Lake Documentation☆49Updated 11 months ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 10 months ago
- An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.☆50Updated last year
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆70Updated 8 months ago
- Sample project to demonstrate data engineering best practices☆191Updated last year
- Execution of DBT models using Apache Airflow through Docker Compose☆117Updated 2 years ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- This repository contains examples of how to use dbt's metric functionality on the jaffle shop dataset☆29Updated 6 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 2 years ago
- A curated list of awesome public DBT projects☆134Updated last year
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆25Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- Code for "Advanced data transformations in SQL" free live workshop☆81Updated last month