☆21Nov 4, 2023Updated 2 years ago
Alternatives and similar repositories for Data-Pipeline-using-Airflow-DBT-and-GCP
Users that are interested in Data-Pipeline-using-Airflow-DBT-and-GCP are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. Ther…☆27Aug 22, 2025Updated 8 months ago
- Presenting 3 ways to run Spark over containers, this project is recommended to those who seek to explore Big Data out of a Hadoop Cluster…☆11Nov 25, 2020Updated 5 years ago
- Pipeline de Dados com NIFI para consultar API Rest, publicar dados no Kafka, consumir esses dados e salvar no S3☆11Sep 15, 2022Updated 3 years ago
- learning-by-doing data model built with dbt-core☆17Apr 10, 2026Updated last month
- ☆11Mar 15, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Google Cloud Pubsub connector for Spark Streaming☆17Oct 21, 2021Updated 4 years ago
- ☆14Dec 15, 2020Updated 5 years ago
- The codes for the paper of "A particle swarm optimization-based flexible convolutional auto-encoder for image classification" published b…☆10Jul 21, 2020Updated 5 years ago
- ☆10Jan 31, 2021Updated 5 years ago
- Resources from B-Sides Bloomington OSINT Workshop☆13Sep 14, 2024Updated last year
- ☆21Nov 21, 2023Updated 2 years ago
- Backend API developed using FastAPI for a simplified version of a digital book collection.☆17Sep 17, 2024Updated last year
- B19415 - The Definitive Guide to Data Integration☆11Apr 15, 2024Updated 2 years ago
- Based on our paper "Pneumonia Detection from Lung X-ray Images using Local Search Aided Sine Cosine Algorithm based Deep Feature Selectio…☆11Jun 26, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Online Fashion Commerce Website☆10Nov 24, 2025Updated 5 months ago
- ☆10Sep 30, 2020Updated 5 years ago
- Execute DBT core on cloud run☆22May 6, 2024Updated 2 years ago
- ☆26Apr 1, 2024Updated 2 years ago
- Introduction to Modern Data Analytics Tools Docker, Airbyte, DBT, Apache Superset with Brazilian Ecommerce Data & Applying RFM in DBT☆13Sep 8, 2022Updated 3 years ago
- ☆14Jul 28, 2023Updated 2 years ago
- Data Engineering Handbook for beginners and everyone☆79Jul 13, 2024Updated last year
- Code examples and experiments from https://engineeringfordatascience.com☆38Aug 27, 2023Updated 2 years ago
- Edit Open Data Contract Standard in Excel☆35Apr 1, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Data Observability for Data Engineering, published by Packt Publishing☆11Jan 24, 2025Updated last year
- create kubernetes cluster on AWS only typing 'terraform apply' on 3 minutes.☆16Jul 5, 2019Updated 6 years ago
- ☆15Mar 23, 2026Updated last month
- Simple python implementation of stochastic gradient descent for neural networks through backpropagation.☆12Dec 29, 2023Updated 2 years ago
- sleep apnea, time window, artificial neural network, time series, MLP☆18Jan 17, 2020Updated 6 years ago
- ☆16Mar 9, 2026Updated 2 months ago
- SQL static analyzer for performance, security, compliance and cost. 272 rules. Completely offline. Works in CI pipelines.☆150May 12, 2026Updated last week
- This repository is a working ETL framework which utilizes user data from Spotify API using ➲Python for Extraction and Transformation ➲SQL…☆12Apr 16, 2023Updated 3 years ago
- An end-to-end, containerized data pipeline for near-real-time user event analytics using Kafka, ClickHouse, Airflow, and PySpark. Made to…☆78Sep 12, 2025Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆12Sep 9, 2023Updated 2 years ago
- Project for cd12354: Movie Picture Pipeline☆12Aug 2, 2024Updated last year
- 😴 DeepSleep2 is a compact U-Net-inspired convolutional neural network with 740,551 parameters, designed to predict non-apnea sleep arous…☆22Aug 30, 2025Updated 8 months ago
- This repository contains an example of how to leverage Cloud Composer and Cloud Dataflow to move data from a Microsoft SQL Server to BigQ…☆19Mar 25, 2026Updated last month
- Rust version of Lodash☆11Jul 5, 2023Updated 2 years ago
- End-to-End-Graphrag-implementation☆24Jul 16, 2024Updated last year
- Chrome browser extension that limits you to 20 open tabs☆57Nov 21, 2013Updated 12 years ago