chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCPLinks
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆24Updated this week
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below
Sorting:
- Code for dbt tutorial☆156Updated 3 weeks ago
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- ☆17Updated 10 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆43Updated 7 months ago
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆21Updated last year
- Cloned by the `dbt init` task☆60Updated last year
- build dw with dbt☆46Updated 8 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 2 years ago
- End to end data engineering project☆56Updated 2 years ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆71Updated last year
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆142Updated 11 months ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆38Updated last year
- Execution of DBT models using Apache Airflow through Docker Compose☆116Updated 2 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆84Updated 2 years ago
- Building a Data Pipeline with an Open Source Stack☆55Updated 11 months ago
- ☆133Updated 4 months ago
- End-to-end data platform leveraging the Modern data stack☆49Updated last year
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆15Updated 2 months ago
- Data Engineering with Databricks Cookbook, published by Packt☆91Updated last year
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 10 months ago
- Repository for Data Engineering Zoomcamp 2024☆14Updated last year
- demo examples how to load data from different sources to different destinations☆21Updated 4 months ago
- Simple stream processing pipeline☆102Updated last year
- ☆87Updated 5 months ago
- New generation opensource data stack☆69Updated 3 years ago
- ☆55Updated last month
- Analytics engineering with dbt - projects and developer environment☆18Updated 9 months ago
- A tutorial for the Great Expectations library.☆71Updated 4 years ago
- Data engineering with dbt, published by Packt☆79Updated last year
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago