This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆29Aug 22, 2025Updated last year
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Django with Data Science [Video], published by Packt☆12Dec 15, 2025Updated 9 months ago
- ☆19Jan 25, 2022Updated 4 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- Example code for the dbt core Learn tutorial. The Astro dbt provider, also known as Cosmos, is a tool automatically integrate dbt models …☆17Mar 7, 2025Updated last year
- A collection of helpful tricks for Playwright tests☆14May 12, 2026Updated 4 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Capstone Project for DataExpert.io V4 Cohort☆14Jul 8, 2024Updated 2 years ago
- Source code for https://inscribe.scrypt.io☆15Mar 13, 2024Updated 2 years ago
- ☆17Apr 4, 2025Updated last year
- sCrypt library - Zero-Knowledge Proofs - curve BLS12-381 步行者☆13Mar 14, 2025Updated last year
- Awesome MCP Servers for ... everything☆24May 14, 2025Updated last year
- Share of job postings containing AI and GenAI-related terms☆13Sep 10, 2026Updated last week
- Materials for the next course☆25Feb 3, 2023Updated 3 years ago
- Machine Learning Data Pipelines Presentation☆17Nov 2, 2023Updated 2 years ago
- An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.☆62Mar 22, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆29Jun 11, 2023Updated 3 years ago
- Allows AI Agents to interact with the Twilio SendGrid v3 API, managing contact lists, templates, single sends, and stats☆31Feb 25, 2025Updated last year
- Curating the best Libra project and resource☆11Jul 8, 2019Updated 7 years ago
- ☆10Jul 24, 2022Updated 4 years ago
- Intended for internal use: deploys all infrastructure required for Astronomer to run on GCP☆13May 6, 2025Updated last year
- A collection of AWS templates for deploying AI Agents☆20Oct 17, 2024Updated last year
- Evidence.dev AWS Athena data source☆14Jun 22, 2026Updated 3 months ago
- Thai sentiment analysis dataset☆10Sep 29, 2019Updated 6 years ago
- Udacity Data Engineering Nanodegree Capstone Project☆36May 9, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- pentagame on the screen: https://pentagame.herokuapp.com/☆10Dec 12, 2020Updated 5 years ago
- ☆11Apr 24, 2023Updated 3 years ago
- 💬 Minimalistic repository to reproduce and serve CAMEL models.☆25Jun 26, 2023Updated 3 years ago
- 💬 1,400+ AI personas for LLMs and agents.☆26Aug 21, 2026Updated last month
- Collection of Apps Script based tools for Google Workspace☆36Mar 2, 2026Updated 6 months ago
- A Kubernetes operator for managing Prefect servers and work pools☆23Updated this week
- MCP server to extract contents from a PDF file☆33May 31, 2025Updated last year
- ⏲️ Cron Quartz and Cron UNIX expression parser.☆11Sep 7, 2025Updated last year
- Python class to gather stats and slab keys from memcached via the memcached telnet interface☆10Feb 7, 2017Updated 9 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 📈 Unlock the future of trading with TensorForce! Our AI-powered platform automates stock trading and hosts a marketplace for diverse tra…☆16Aug 10, 2025Updated last year
- This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster☆15Sep 9, 2021Updated 5 years ago
- This project tries to use AI, specifically reinforcement learning, to manage a stock portfolio. The objective is to be practical. So this…☆19May 5, 2019Updated 7 years ago
- ชี้ทางรวย เบอร์โคตรสวย หมวยลำเค็ญ ชิตังเม โป้ง สาธุ☆13Jul 15, 2018Updated 8 years ago
- Data models for Segment built using dbt (getdbt.com).☆12Jul 31, 2024Updated 2 years ago
- Large language models to diffusion finetuning code☆26Jun 2, 2025Updated last year
- Kubernetes และ Continuous Delivery Pipeline ผ่าน Jenkins พร้อมคำอธิบาย Jenkins Pipeline Syntax อย่างละเอียด☆11Oct 30, 2020Updated 5 years ago