This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆27Aug 22, 2025Updated 8 months ago
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Nov 4, 2023Updated 2 years ago
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆20Aug 21, 2025Updated 8 months ago
- ☆13Jun 9, 2022Updated 3 years ago
- ☆14Apr 18, 2023Updated 3 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆48Apr 5, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Python code that will collapse structured columns separating out the attributes into new columns☆10Mar 15, 2022Updated 4 years ago
- ☆10Jan 31, 2021Updated 5 years ago
- Santiment Knowledge Base 📜☆16Updated this week
- This is a collection of simple asynchronous RESToverHTTP and JSON-RPCoverWebSocket examples of how to interact with a few Crypto Exchange…☆11May 30, 2024Updated last year
- Large language models to diffusion finetuning code☆26Jun 2, 2025Updated 10 months ago
- Generate n8n nodes from OpenAPI specs. Experimental.☆19Sep 4, 2025Updated 7 months ago
- Speak Slack notifications and process Slack slash commands☆15Dec 20, 2018Updated 7 years ago
- Project repository of Apache Airflow, deployed on Docker in Amazon EC2 via GitLab.☆15Sep 3, 2021Updated 4 years ago
- Dataproc Scala Examples is an effort to assist in the creation of Spark jobs written in Scala to run on Dataproc.☆12Mar 26, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Low-code/No-code development platform☆12Dec 26, 2023Updated 2 years ago
- ☆18Jan 25, 2022Updated 4 years ago
- This is a simple ETL using Airflow. First, we fetch data from API (extract). Then, we drop unused columns, convert to CSV, and validate (…☆24Oct 12, 2019Updated 6 years ago
- MCP server for the Delinea Secret Server and Platform APIs☆46Updated this week
- ☆13Dec 18, 2024Updated last year
- ☆17Apr 4, 2025Updated last year
- MCP Server for Apache Airflow☆32Oct 14, 2025Updated 6 months ago
- Modern approach to blog development with Nuxt.js with attention to detail.☆21Feb 2, 2023Updated 3 years ago
- NO CODE Agent and work flow builder. Typically canvas's are one or the other. We didnt like that so we created Smart canvas☆21Jul 18, 2025Updated 9 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- MCP Server for Dropbox☆27Jul 16, 2025Updated 9 months ago
- golang code snippets☆15Oct 3, 2020Updated 5 years ago
- Verify that a local file is identical to an object on Amazon S3, without having to download the object.☆12Sep 6, 2024Updated last year
- Ansible role for install powerlevel10k☆19Apr 10, 2026Updated 2 weeks ago
- ☆21Oct 2, 2025Updated 6 months ago
- ☆21Jan 14, 2025Updated last year
- ☆30Apr 12, 2025Updated last year
- automatic backup your mysql database then upload the file to your Google Drive☆19Oct 8, 2016Updated 9 years ago
- ☆10Jul 2, 2016Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Select the job you want on LinkedIn Jobs, press the extension's button and watch it go through the steps.☆25Dec 12, 2024Updated last year
- A collection of AWS templates for deploying AI Agents☆21Oct 17, 2024Updated last year
- Base repository for the IMAD course app. PLEASE DO NOT submit PRs, or push to this git repository!☆23Jun 3, 2024Updated last year
- Medical AI Assistant - Production-Ready Healthcare Application☆36Mar 26, 2026Updated last month
- This project is designed for a simple LLM agent with tools on a clinical knowledge graph in Neo4j.☆26May 27, 2025Updated 11 months ago
- Flink dynamic CEP demo☆20Mar 22, 2022Updated 4 years ago
- Data Scraping and Data Mining from Beginner to Pro with Python, by Packt publishing☆14Jan 30, 2023Updated 3 years ago