chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCPLinks
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆24Updated 2 months ago
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below
Sorting:
- ☆20Updated last year
- Cloned by the `dbt init` task☆62Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆46Updated 11 months ago
- Code for dbt tutorial☆162Updated last month
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- ☆15Updated 2 years ago
- New generation opensource data stack☆74Updated 3 years ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆78Updated 2 years ago
- build dw with dbt☆47Updated last year
- End-to-end data platform leveraging the Modern data stack☆52Updated last year
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆21Updated 2 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆121Updated 2 years ago
- Analytics engineering with dbt - projects and developer environment☆21Updated last year
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 2 years ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆151Updated last year
- Simple stream processing pipeline☆110Updated last year
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆41Updated last year
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆128Updated 3 weeks ago
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆18Updated 2 months ago
- Building a Data Pipeline with an Open Source Stack☆54Updated 4 months ago
- End to end data engineering project☆57Updated 3 years ago
- Code for "Advanced data transformations in SQL" free live workshop☆85Updated 5 months ago
- Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…☆68Updated 4 months ago
- Cost Efficient Data Pipelines with DuckDB☆58Updated 5 months ago
- Capstone Project for DataExpert.io V4 Cohort☆11Updated last year
- Sample files, code snippets and downloads for Snowflake labs and tutorials.☆232Updated last week
- ☆38Updated 7 months ago
- ☆211Updated 9 months ago
- ☆27Updated 6 months ago
- A curated list of awesome public DBT projects☆151Updated last year