chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCPLinks
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆24Updated last month
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below
Sorting:
- Cloned by the `dbt init` task☆62Updated last year
- build dw with dbt☆46Updated 11 months ago
- Code for dbt tutorial☆161Updated last month
- ☆90Updated 9 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆45Updated 11 months ago
- ☆20Updated last year
- End-to-end data platform leveraging the Modern data stack☆51Updated last year
- Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…☆68Updated 3 months ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆88Updated 2 years ago
- Simple stream processing pipeline☆110Updated last year
- Code snippets for Data Engineering Design Patterns book☆207Updated 6 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 2 years ago
- New generation opensource data stack☆73Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆56Updated 4 years ago
- Sample files, code snippets and downloads for Snowflake labs and tutorials.☆222Updated last week
- Analytics engineering with dbt - projects and developer environment☆21Updated last year
- Execution of DBT models using Apache Airflow through Docker Compose☆120Updated 2 years ago
- Data engineering with dbt, published by Packt☆86Updated last month
- ☆28Updated 5 months ago
- ☆139Updated 7 months ago
- End to end data engineering project☆57Updated 2 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆182Updated 3 years ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated 2 years ago
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆17Updated last month
- Code for "Advanced data transformations in SQL" free live workshop☆84Updated 5 months ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆149Updated last year
- Building a Data Pipeline with an Open Source Stack☆53Updated 3 months ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Updated 2 years ago
- Collection of Snowflake Notebook demos, tutorials, and examples☆290Updated last week
- Capstone Project for DataExpert.io V4 Cohort☆11Updated last year