chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCPLinks
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆24Updated last week
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below
Sorting:
- Cloned by the `dbt init` task☆61Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆45Updated 9 months ago
- Code snippets for Data Engineering Design Patterns book☆150Updated 5 months ago
- ☆88Updated 8 months ago
- ☆18Updated last year
- Code for dbt tutorial☆159Updated 2 months ago
- Data engineering with dbt, published by Packt☆85Updated last year
- Analytics engineering with dbt - projects and developer environment☆21Updated 11 months ago
- End-to-end data platform leveraging the Modern data stack☆51Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆76Updated 2 years ago
- ☆139Updated 6 months ago
- ☆14Updated 2 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆88Updated 2 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 2 years ago
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆57Updated 2 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆118Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆56Updated 4 years ago
- Dagster University courses☆109Updated last week
- build dw with dbt☆47Updated 10 months ago
- Sample files, code snippets and downloads for Snowflake labs and tutorials.☆216Updated this week
- Data Engineering examples for Airflow, Prefect; dbt for BigQuery, Redshift, ClickHouse, Postgres, DuckDB; PySpark for Batch processing; K…☆66Updated 2 months ago
- 🥪🦘 An open source sandbox project exploring dbt workflows via a fictional sandwich shop's data.☆205Updated last week
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated last year
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆124Updated last week
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- End to end data engineering project☆57Updated 2 years ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆148Updated last year
- ☆206Updated 7 months ago
- Building a Data Pipeline with an Open Source Stack☆55Updated 2 months ago
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆21Updated last year