☆21Nov 4, 2023Updated 2 years ago
Alternatives and similar repositories for Data-Pipeline-using-Airflow-DBT-and-GCP
Users that are interested in Data-Pipeline-using-Airflow-DBT-and-GCP are comparing it to the libraries listed below
Sorting:
- This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. Ther…☆27Aug 22, 2025Updated 6 months ago
- This Power BI project provides insights into customer orders and product tracking using interactive dashboards. It visualizes order statu…☆10Aug 15, 2025Updated 7 months ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆11Jul 13, 2023Updated 2 years ago
- Presenting 3 ways to run Spark over containers, this project is recommended to those who seek to explore Big Data out of a Hadoop Cluster…☆11Nov 25, 2020Updated 5 years ago
- Pipeline de Dados com NIFI para consultar API Rest, publicar dados no Kafka, consumir esses dados e salvar no S3☆11Sep 15, 2022Updated 3 years ago
- Google Cloud Pubsub connector for Spark Streaming☆17Oct 21, 2021Updated 4 years ago
- ☆11Mar 15, 2025Updated last year
- ☆14Dec 15, 2020Updated 5 years ago
- The codes for the paper of "A particle swarm optimization-based flexible convolutional auto-encoder for image classification" published b…☆10Jul 21, 2020Updated 5 years ago
- ☆21Nov 21, 2023Updated 2 years ago
- B19415 - The Definitive Guide to Data Integration☆11Apr 15, 2024Updated last year
- Tutorial for using Cloud Vision API and App Engine to enable search and categorization of images.☆17May 19, 2020Updated 5 years ago
- Based on our paper "Pneumonia Detection from Lung X-ray Images using Local Search Aided Sine Cosine Algorithm based Deep Feature Selectio…☆11Jun 26, 2022Updated 3 years ago
- ☆18May 9, 2024Updated last year
- Online Fashion Commerce Website☆11Nov 24, 2025Updated 3 months ago
- Reference and learning notebooks on the use of Spark for ML and analytical applications☆11Mar 1, 2019Updated 7 years ago
- ☆10Sep 30, 2020Updated 5 years ago
- Udacity Data Engineering Nanodegree Project 3☆12Jul 14, 2019Updated 6 years ago
- An end-to-end, containerized data pipeline for near-real-time user event analytics using Kafka, ClickHouse, Airflow, and PySpark. Made to…☆57Sep 12, 2025Updated 6 months ago
- Testes de Qualidade em Dados com Great Expectation e Spark☆21Jul 17, 2023Updated 2 years ago
- ☆37Jun 8, 2022Updated 3 years ago
- The official repository for the Rock the JVM Flink course☆31Dec 30, 2025Updated 2 months ago
- Introduction to Modern Data Analytics Tools Docker, Airbyte, DBT, Apache Superset with Brazilian Ecommerce Data & Applying RFM in DBT☆13Sep 8, 2022Updated 3 years ago
- BigQuery connector for Apache Flink☆38Updated this week
- Faye Ellis, Hands-on AWS Troubleshooting (1127)☆10Jul 12, 2023Updated 2 years ago
- Edit Open Data Contract Standard in Excel☆35Dec 1, 2025Updated 3 months ago
- ☆23Mar 18, 2022Updated 4 years ago
- Data Observability for Data Engineering, published by Packt Publishing☆11Jan 24, 2025Updated last year
- Practical guidlines with machine learning lifecycle especially in computer vision domains☆16Jun 16, 2023Updated 2 years ago
- create kubernetes cluster on AWS only typing 'terraform apply' on 3 minutes.☆16Jul 5, 2019Updated 6 years ago
- ☆15Dec 15, 2023Updated 2 years ago
- Extract GLCM, Region Properties, and Moments related features in a line of code and then get those into a data-frame.☆13Sep 15, 2020Updated 5 years ago
- ☆16Mar 9, 2026Updated last week
- Examples, tutorials, and how-to guides☆10Oct 4, 2024Updated last year
- ☆12Sep 9, 2023Updated 2 years ago
- This repository is a working ETL framework which utilizes user data from Spotify API using ➲Python for Extraction and Transformation ➲SQL…☆12Apr 16, 2023Updated 2 years ago
- ☆12Dec 18, 2020Updated 5 years ago
- ☆26Aug 1, 2025Updated 7 months ago
- Project for cd12354: Movie Picture Pipeline☆12Aug 2, 2024Updated last year