This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.
☆28Aug 22, 2025Updated last year
Alternatives and similar repositories for Data-Pipeline-with-dbt-using-Airflow-on-GCP
Users that are interested in Data-Pipeline-with-dbt-using-Airflow-on-GCP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project involves portfolio optimization using Monte Carlo simulation to identify an optimal investment portfolio that maximizes retu…☆15Mar 11, 2026Updated 7 months ago
- Low-code/No-code development platform☆12Dec 26, 2023Updated 2 years ago
- Python Projects with their source code to inspire you .☆21May 28, 2022Updated 4 years ago
- Project repository of Apache Airflow, deployed on Docker in Amazon EC2 via GitLab.☆16Sep 3, 2021Updated 5 years ago
- Gradient Boosting Models on Real-Time Sensor Data for AI-Enhanced Vehicle Predictive Maintenance. By using a web-based interface to forec…☆19Oct 20, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Curated list of AI tools for sales automation, LinkedIn outreach, cold email, and B2B lead generation.☆22Jun 21, 2025Updated last year
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- Example code for the dbt core Learn tutorial. The Astro dbt provider, also known as Cosmos, is a tool automatically integrate dbt models …☆17Mar 7, 2025Updated last year
- Flowrunner is a lightweight package to organize and represent Data Engineering/Science workflows☆11Jun 26, 2023Updated 3 years ago
- This is a project of mine which includes all the python skills I have learnt ! This is a virtual desktop as well as web assistant ! The m…☆12Nov 3, 2020Updated 6 years ago
- Getting started with Datomic!☆11Nov 29, 2024Updated last year
- A powerful local proxy for Claude Code CLI and Codex CLI supporting NVIDIA NIM, Google,Gemini, DeepSeek, and local Ollama models. Use cla…☆31Sep 3, 2026Updated 2 months ago
- Collection of reference implementations for lakehouse patterns with Bauplan and Prefect☆12Dec 23, 2025Updated 10 months ago
- 参考 Chat2DB 的效果，使用 chatgpt 进行自然语言翻译，然后对数据库进行操作，使用 rust 语言实现的 web 应用。☆10Jan 13, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Verify that a local file is identical to an object on Amazon S3, without having to download the object.☆12Sep 6, 2024Updated 2 years ago
- Python for Software Engineering Bootcamp, by Packt Publishing☆10Jan 18, 2023Updated 3 years ago
- List of Reports and Guides related to AI, Machine Learning, Agentic AI, AI Agents, Deep Learning, LLMs etc☆16Aug 31, 2025Updated last year
- Open-source alternative of Whisper flow. BYOK☆30Updated this week
- Demo implementation of a reactive multi agent bot that can answer questions based on relational database information to demonstrate diffe…☆32Mar 4, 2025Updated last year
- Web app designed to enhance your interaction with OpenAI's language models☆12Oct 7, 2026Updated 3 weeks ago
- Open-source AI SEO & GEO platform. Track your brand in ChatGPT, Perplexity, Gemini, Claude & Google AI Overviews, plus keyword research, …☆21Updated this week
- Welcome to LLM-Utility-Cookbook! Here you'll find tools to make LLMs easy: voice to text, text to voice, document scan to text, prompt ma…☆17Jun 12, 2023Updated 3 years ago
- LangCost is a cost intelligence and fault attribution engine for AI systems & Coding Agents to pinpoint where tokens are wasted, and wha…☆22Jun 3, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A collection of helpful tricks for Playwright tests☆13May 12, 2026Updated 5 months ago
- MCP Client and Server apps to demo integration of Azure OpenAI-based AI agent with a Data Warehouse, exposed through GraphQL in Microsoft…☆11Jul 6, 2025Updated last year
- Create a QnA bot on a pdf☆16May 27, 2023Updated 3 years ago
- Backtest portfolio allocation strategies.☆13May 20, 2021Updated 5 years ago
- Superset-patchup is a python package that "patches" Superset to add custom functionality that we find to be useful☆11Sep 6, 2023Updated 3 years ago
- Luminous Onion is a cutting-edge web application designed to revolutionize vulnerability management by seamlessly ingesting security repo…☆13Oct 5, 2026Updated 3 weeks ago
- Data Scraping and Data Mining from Beginner to Pro with Python, by Packt publishing☆14Jan 30, 2023Updated 3 years ago
- This Repo shows how to integrate LangChain, Open AI and store embeddings in the MongoDB Atlas and run a similarity search using MongoDB V…☆12Apr 23, 2026Updated 6 months ago
- Catch tech debt and hidden risks before they become incidents. Add m in front of github.com/user/repo to find functions and trace the log…☆19Aug 27, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Jun 23, 2025Updated last year
- A library for building smart contracts with `scrypt-ts`.☆12Mar 27, 2025Updated last year
- ☆10Jul 24, 2022Updated 4 years ago
- Simple WebRTC audio/video conferencing demo using SkylinkJS and React.☆13Jun 16, 2015Updated 11 years ago
- A tool which allows us to automatically scrape the data we want from a website of our choice.☆10Jan 2, 2024Updated 2 years ago
- A sleek and fully customizable chatbot built using Nextjs and Typescript.☆13Sep 14, 2024Updated 2 years ago
- A Django based, hourly work logging app which supports job coding, view filtering, csv report generation and an e-mail reminder system☆13Dec 12, 2012Updated 13 years ago