This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆27Aug 22, 2025Updated 8 months ago
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project aims to leverage Amazon Web Services to create trending Youtube videos analytics service. Project contains different data en…☆22Aug 16, 2025Updated 9 months ago
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆23Aug 21, 2025Updated 8 months ago
- ☆13Jun 9, 2022Updated 3 years ago
- ☆14Apr 18, 2023Updated 3 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Apr 5, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This is a collection of simple asynchronous RESToverHTTP and JSON-RPCoverWebSocket examples of how to interact with a few Crypto Exchange…☆11May 30, 2024Updated last year
- Large language models to diffusion finetuning code☆26Jun 2, 2025Updated 11 months ago
- Generate n8n nodes from OpenAPI specs. Experimental.☆19Sep 4, 2025Updated 8 months ago
- Project repository of Apache Airflow, deployed on Docker in Amazon EC2 via GitLab.☆15Sep 3, 2021Updated 4 years ago
- Example code for the dbt core Learn tutorial. The Astro dbt provider, also known as Cosmos, is a tool automatically integrate dbt models …☆17Mar 7, 2025Updated last year
- A library for building data extraction jobs for ETH events☆18Jun 17, 2024Updated last year
- Presentation of Design Patterns in Java☆25Feb 26, 2018Updated 8 years ago
- Low-code/No-code development platform☆12Dec 26, 2023Updated 2 years ago
- Welcome to LLM-Utility-Cookbook! Here you'll find tools to make LLMs easy: voice to text, text to voice, document scan to text, prompt ma…☆17Jun 12, 2023Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Jan 25, 2022Updated 4 years ago
- MCP server for the Delinea Secret Server and Platform APIs☆46Updated this week
- Repository for Data Engineering Zoomcamp 2024☆14Mar 25, 2024Updated 2 years ago
- ☆13Dec 18, 2024Updated last year
- MCP Server for Apache Airflow☆32Oct 14, 2025Updated 7 months ago
- ☆17Apr 4, 2025Updated last year
- ☆17Jan 26, 2017Updated 9 years ago
- Jira shell scripts☆39Nov 18, 2023Updated 2 years ago
- Code samples for working with Santiment's API and libraries☆23Aug 5, 2025Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A collection of helpful tricks for Playwright tests☆12May 12, 2026Updated last week
- ☆21Oct 2, 2025Updated 7 months ago
- A Kubernetes operator for managing Prefect servers and work pools☆17May 11, 2026Updated last week
- Medical AI Assistant - Production-Ready Healthcare Application☆35Mar 26, 2026Updated last month
- 💬 Minimalistic repository to reproduce and serve CAMEL models.☆25Jun 26, 2023Updated 2 years ago
- See the kind of artist you are on Github☆24Sep 6, 2021Updated 4 years ago
- Data Scraping and Data Mining from Beginner to Pro with Python, by Packt publishing☆14Jan 30, 2023Updated 3 years ago
- ☆28Jun 11, 2023Updated 2 years ago
- This project tries to use AI, specifically reinforcement learning, to manage a stock portfolio. The objective is to be practical. So this…☆19May 5, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This Repo shows how to integrate LangChain, Open AI and store embeddings in the MongoDB Atlas and run a similarity search using MongoDB V…☆12Apr 23, 2026Updated 3 weeks ago
- Share of job postings containing AI and GenAI-related terms☆12May 11, 2026Updated last week
- A sleek and fully customizable chatbot built using Nextjs and Typescript.☆13Sep 14, 2024Updated last year
- An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.☆60Mar 22, 2024Updated 2 years ago
- Capstone Project for DataExpert.io V4 Cohort☆13Jul 8, 2024Updated last year
- Repository for building docker image, with open-source applications☆26Apr 23, 2024Updated 2 years ago
- a docker image for OpenManus☆20Mar 14, 2025Updated last year