chayansraj / Data-Pipeline-with-dbt-using-Airflow-on-GCPLinks
This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆25Updated 5 months ago
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below
Sorting:
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆46Updated last month
- Code for dbt tutorial☆166Updated 4 months ago
- Cloned by the `dbt init` task☆62Updated last year
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆23Updated 2 years ago
- ☆21Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆80Updated 2 years ago
- End-to-end data platform leveraging the Modern data stack☆52Updated last year
- build dw with dbt☆50Updated last year
- Analytics engineering with dbt - projects and developer environment☆22Updated last year
- ☆15Updated 2 years ago
- New generation opensource data stack☆76Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- A tutorial for the Great Expectations library.☆72Updated 4 years ago
- Data engineering with dbt, published by Packt☆89Updated 5 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 3 years ago
- Data lake, data warehouse on GCP☆58Updated 4 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆126Updated 3 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆91Updated 2 years ago
- End to end data engineering project☆58Updated 3 years ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Updated 2 years ago
- ☆40Updated 10 months ago
- Dagster University courses☆121Updated this week
- A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Da…☆28Updated 3 years ago
- Code snippets for Data Engineering Design Patterns book☆324Updated last month
- Python data repo, jupyter notebook, python scripts and data.☆547Updated last year
- Building a Data Pipeline with an Open Source Stack☆55Updated 7 months ago
- ☆92Updated last year
- Code for "Advanced data transformations in SQL" free live workshop☆89Updated 8 months ago
- Delta-Lake, ETL, Spark, Airflow☆48Updated 3 years ago
- ☆142Updated 11 months ago