ArkanNibrastama / ecommerce_data_pipelineLinks
This project contain build end-to-end e-commerce data from data source into data warehouse and visualization.
☆13Updated 9 months ago
Alternatives and similar repositories for ecommerce_data_pipeline
Users that are interested in ecommerce_data_pipeline are comparing it to the libraries listed below
Sorting:
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆32Updated last year
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆41Updated last year
- ☆141Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆23Updated 2 years ago
- ☆28Updated last year
- Code for "Advanced data transformations in SQL" free live workshop☆82Updated last month
- Generate synthetic Spotify music stream dataset to create dashboards. Spotify API generates fake event data emitted to Kafka. Spark consu…☆68Updated last year
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆77Updated last year
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆9Updated 2 years ago
- This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.☆78Updated 10 months ago
- Apartments Data Pipeline using Airflow and Spark.☆21Updated 3 years ago
- ☆51Updated last year
- Sample repo for startdataengineering DE 101 free course☆64Updated last year
- ☆151Updated 3 years ago
- ☆16Updated 2 years ago
- YouTube tutorial project☆103Updated last year
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Updated last year
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆20Updated 9 months ago
- Uber Data Engineering Pipeline using Mage AI and BigQuery☆22Updated 11 months ago
- ☆21Updated last year
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆25Updated 2 years ago
- ☆65Updated 3 weeks ago
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆146Updated last year
- Ravi Azure ADB ADF Repository☆66Updated 4 months ago
- 📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.☆45Updated 5 months ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆195Updated last year
- An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Az…☆23Updated last year
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆96Updated 3 months ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆143Updated last year
- Demo Codes will be shared here☆48Updated 7 months ago