This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆28Aug 22, 2025Updated 9 months ago
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Nov 4, 2023Updated 2 years ago
- This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data en…☆22Aug 16, 2025Updated 9 months ago
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆24Aug 21, 2025Updated 9 months ago
- ☆13Jun 9, 2022Updated 4 years ago
- ☆14Apr 18, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Apr 5, 2026Updated 2 months ago
- Python code that will collapse structured columns separating out the attributes into new columns☆10Mar 15, 2022Updated 4 years ago
- ☆10Jan 31, 2021Updated 5 years ago
- Santiment Knowledge Base 📜☆16Jun 1, 2026Updated last week
- Training of Noise-to-Image Diffusion Model on Multi-Channel Brain Tumor MRI Scans.☆12Jan 12, 2023Updated 3 years ago
- ☆10Sep 30, 2020Updated 5 years ago
- Generate n8n nodes from OpenAPI specs. Experimental.☆20Sep 4, 2025Updated 9 months ago
- Speak Slack notifications and process Slack slash commands☆15Dec 20, 2018Updated 7 years ago
- Example code for the dbt core Learn tutorial. The Astro dbt provider, also known as Cosmos, is a tool automatically integrate dbt models …☆17Mar 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A library for building data extraction jobs for ETH events☆18Jun 17, 2024Updated last year
- Welcome to LLM-Utility-Cookbook! Here you'll find tools to make LLMs easy: voice to text, text to voice, document scan to text, prompt ma…☆17Jun 12, 2023Updated 2 years ago
- CLInt is a smart CLI generator for BASH scripts☆11Mar 5, 2025Updated last year
- MCP server for the Delinea Secret Server and Platform APIs☆46Jun 2, 2026Updated last week
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- ☆13Dec 18, 2024Updated last year
- MCP Server for Apache Airflow☆33Oct 14, 2025Updated 7 months ago
- Collection of awesome ChatGPT prompts to get better results. Use these with any AI writer to converse smartly.☆17Mar 12, 2023Updated 3 years ago
- Machine Learning Data Pipelines Presentation☆17Nov 2, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Verify that a local file is identical to an object on Amazon S3, without having to download the object.☆12Sep 6, 2024Updated last year
- Ansible role for install powerlevel10k☆19Apr 10, 2026Updated 2 months ago
- Jira shell scripts☆39Nov 18, 2023Updated 2 years ago
- End-to-End-Graphrag-implementation☆24Jul 16, 2024Updated last year
- The Angular CLI Docker Images (v1.0.0-latest)☆13Sep 12, 2022Updated 3 years ago
- ☆21Oct 2, 2025Updated 8 months ago
- automatic backup your mysql database then upload the file to your Google Drive☆19Oct 8, 2016Updated 9 years ago
- A Kubernetes operator for managing Prefect servers and work pools☆17Jun 3, 2026Updated last week
- Select the job you want on LinkedIn Jobs, press the extension's button and watch it go through the steps.☆25Dec 12, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆21Jan 14, 2025Updated last year
- Base repository for the IMAD course app. PLEASE DO NOT submit PRs, or push to this git repository!☆23Jun 3, 2024Updated 2 years ago
- This project is designed for a simple LLM agent with tools on a clinical knowledge graph in Neo4j.☆26May 27, 2025Updated last year
- Medical AI Assistant - Production-Ready Healthcare Application☆35Mar 26, 2026Updated 2 months ago
- See the kind of artist you are on Github☆24Sep 6, 2021Updated 4 years ago
- Data Scraping and Data Mining from Beginner to Pro with Python, by Packt publishing☆14Jan 30, 2023Updated 3 years ago
- Test Driven Development Class For O'Reilly Publishing☆16Jul 6, 2018Updated 7 years ago