This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆29Aug 22, 2025Updated 11 months ago
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆24Aug 21, 2025Updated 11 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Apr 5, 2026Updated 4 months ago
- Django with Data Science [Video], published by Packt☆12Dec 15, 2025Updated 7 months ago
- [unmaintained] Chrome Browser bindings for DalekJS☆15Jun 4, 2017Updated 9 years ago
- A companion package to IBM Maximo asset monitor pipeline containing sample functions and base classes from which to derive custom functio…☆13Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Repository for Data Engineering Zoomcamp 2024☆14Mar 25, 2024Updated 2 years ago
- Model Context Protocol (MCP) server exposing Interactive Brokers data via ib_async + FastMCP☆16Updated this week
- Data Engineering on GCP☆42Oct 20, 2022Updated 3 years ago
- Example code for the dbt core Learn tutorial. The Astro dbt provider, also known as Cosmos, is a tool automatically integrate dbt models …☆17Mar 7, 2025Updated last year
- ☆17Jan 26, 2017Updated 9 years ago
- Verify that a local file is identical to an object on Amazon S3, without having to download the object.☆12Sep 6, 2024Updated last year
- Welcome to LLM-Utility-Cookbook! Here you'll find tools to make LLMs easy: voice to text, text to voice, document scan to text, prompt ma…☆17Jun 12, 2023Updated 3 years ago
- Deploying a Windows Server EC2 Instance in AWS using Terraform☆22Feb 14, 2022Updated 4 years ago
- Flink dynamic CEP demo☆20Mar 22, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [unmaintained] Command line runner for dalekjs testing framework☆25Jun 4, 2017Updated 9 years ago
- Source code for https://inscribe.scrypt.io☆15Mar 13, 2024Updated 2 years ago
- Angular 4 - Node.js - Express MEAN Stack Social Website☆11Dec 15, 2017Updated 8 years ago
- Data Scraping and Data Mining from Beginner to Pro with Python, by Packt publishing☆14Jan 30, 2023Updated 3 years ago
- ☆17Apr 4, 2025Updated last year
- sCrypt library - Zero-Knowledge Proofs - curve BLS12-381 步行者☆13Mar 14, 2025Updated last year
- List of Reports and Guides related to AI, Machine Learning, Agentic AI, AI Agents, Deep Learning, LLMs etc☆16Aug 31, 2025Updated 11 months ago
- The highest secure note and password manager based on Bitcoin SV☆10Apr 1, 2025Updated last year
- This Repo shows how to integrate LangChain, Open AI and store embeddings in the MongoDB Atlas and run a similarity search using MongoDB V…☆12Apr 23, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Materials for the next course☆25Feb 3, 2023Updated 3 years ago
- A library for building smart contracts with `scrypt-ts`.☆12Mar 27, 2025Updated last year
- API for accessing data from our data catalog.☆17Aug 30, 2022Updated 3 years ago
- Machine Learning Data Pipelines Presentation☆17Nov 2, 2023Updated 2 years ago
- An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.☆61Mar 22, 2024Updated 2 years ago
- ☆16Jun 23, 2025Updated last year
- Automated install for Authelia running in a container e.g. on Proxmox☆30Apr 18, 2023Updated 3 years ago
- Curating the best Libra project and resource☆11Jul 8, 2019Updated 7 years ago
- Generate n8n nodes from OpenAPI specs. Experimental.☆20Sep 4, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Azure AI Services Boot Camp☆10Jul 26, 2019Updated 7 years ago
- A collection of AWS templates for deploying AI Agents☆20Oct 17, 2024Updated last year
- EcoFin is a quantitative economic library☆14Apr 4, 2021Updated 5 years ago
- Evidence.dev AWS Athena data source☆14Jun 22, 2026Updated last month
- Thai sentiment analysis dataset☆10Sep 29, 2019Updated 6 years ago
- UTouch fork configured for 3.5" TFT LCD from mcufriend.com☆10Sep 26, 2014Updated 11 years ago
- 💣 Zip bomb for Browser and Node.js.☆16Jan 4, 2017Updated 9 years ago