This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆28Aug 22, 2025Updated last year
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Nov 4, 2023Updated 2 years ago
- This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data en…☆23Aug 16, 2025Updated last year
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆24Aug 21, 2025Updated last year
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Oct 4, 2026Updated last week
- Low-code/No-code development platform☆12Dec 26, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆10Jan 31, 2021Updated 5 years ago
- Resources from B-Sides Bloomington OSINT Workshop☆13Sep 14, 2024Updated 2 years ago
- Python code that will collapse structured columns separating out the attributes into new columns☆10Mar 15, 2022Updated 4 years ago
- Santiment Knowledge Base 📜☆16Updated this week
- Speak Slack notifications and process Slack slash commands☆15Dec 20, 2018Updated 7 years ago
- A library for building data extraction jobs for ETH events☆18Jun 17, 2024Updated 2 years ago
- Django with Data Science [Video], published by Packt☆12Dec 15, 2025Updated 9 months ago
- ☆19Jan 25, 2022Updated 4 years ago
- This is a simple ETL using Airflow. First, we fetch data from API (extract). Then, we drop unused columns, convert to CSV, and validate (…☆24Oct 12, 2019Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- Data Engineering on GCP☆42Oct 20, 2022Updated 3 years ago
- Modern approach to blog development with Nuxt.js with attention to detail.☆21Feb 2, 2023Updated 3 years ago
- Example code for the dbt core Learn tutorial. The Astro dbt provider, also known as Cosmos, is a tool automatically integrate dbt models …☆17Mar 7, 2025Updated last year
- golang code snippets☆15Oct 3, 2020Updated 6 years ago
- Verify that a local file is identical to an object on Amazon S3, without having to download the object.☆12Sep 6, 2024Updated 2 years ago
- The Angular CLI Docker Images (v1.0.0-latest)☆13Sep 12, 2022Updated 4 years ago
- This project is designed for a simple LLM agent with tools on a clinical knowledge graph in Neo4j.☆27May 27, 2025Updated last year
- Welcome to LLM-Utility-Cookbook! Here you'll find tools to make LLMs easy: voice to text, text to voice, document scan to text, prompt ma…☆17Jun 12, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆10Jul 2, 2016Updated 10 years ago
- Code samples for working with Santiment's API and libraries☆24Aug 5, 2025Updated last year
- A Dockerfile to initialize Shiny-Server and RStudio Server on CentOS7☆14Jul 11, 2019Updated 7 years ago
- ☆31Apr 12, 2025Updated last year
- ☆13Dec 18, 2024Updated last year
- Data Scraping and Data Mining from Beginner to Pro with Python, by Packt publishing☆14Jan 30, 2023Updated 3 years ago
- ☆17Apr 4, 2025Updated last year
- sCrypt library - Zero-Knowledge Proofs - curve BLS12-381 步行者☆13Mar 14, 2025Updated last year
- Collection of awesome ChatGPT prompts to get better results. Use these with any AI writer to converse smartly.☆17Mar 12, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- List of Reports and Guides related to AI, Machine Learning, Agentic AI, AI Agents, Deep Learning, LLMs etc☆16Aug 31, 2025Updated last year
- This Repo shows how to integrate LangChain, Open AI and store embeddings in the MongoDB Atlas and run a similarity search using MongoDB V…☆12Apr 23, 2026Updated 5 months ago
- Awesome MCP Servers for ... everything☆25May 14, 2025Updated last year
- Share of job postings containing AI and GenAI-related terms☆14Updated this week
- A local file operations skill for AI agents: convert, inspect, archive, and extract text☆24Mar 15, 2026Updated 6 months ago
- Materials for the next course☆25Feb 3, 2023Updated 3 years ago
- Machine Learning Data Pipelines Presentation☆17Nov 2, 2023Updated 2 years ago