chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCPLinks
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆24Updated 4 months ago
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below
Sorting:
- Cloned by the `dbt init` task☆62Updated last year
- Code for dbt tutorial☆166Updated 4 months ago
- ☆21Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆46Updated 3 weeks ago
- New generation opensource data stack☆76Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆126Updated 3 years ago
- ☆15Updated 2 years ago
- Data lake, data warehouse on GCP☆58Updated 4 years ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆79Updated 2 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆182Updated 3 years ago
- ☆39Updated 10 months ago
- ☆141Updated 10 months ago
- build dw with dbt☆51Updated last year
- End-to-end data platform leveraging the Modern data stack☆52Updated last year
- Data engineering with dbt, published by Packt☆90Updated 4 months ago
- A Streamlit app that provides insights on your Snowflake account usage.☆62Updated 11 months ago
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- End to end data engineering project☆57Updated 3 years ago
- Sample files, code snippets and downloads for Snowflake labs and tutorials.☆250Updated this week
- The Ultimate Guide to Snowpark, published by Packt☆16Updated last year
- ☆92Updated last year
- Code snippets for Data Engineering Design Patterns book☆307Updated last week
- Cost Efficient Data Pipelines with DuckDB☆60Updated 7 months ago
- Apache Airflow advanced functionalities examples☆21Updated last year
- Covid19 and Iowa Liquor Sales analysis at BigQuery using dbt, Airflow, Marquez, Google Cloud and other modern data stack tools☆14Updated 3 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 3 years ago
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆22Updated 2 years ago
- ☆23Updated 4 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆91Updated 2 years ago