Joshua-omolewa / Retailstore_ETL_pipeline_projectLinks
Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and transforms the raw data (ETL process) using Apache spark to meet business requirements and also enables Data Analyst create Data Visualization using Superset. Airflow is used to orchestrate the pipeline
☆9Updated 2 years ago
Alternatives and similar repositories for Retailstore_ETL_pipeline_project
Users that are interested in Retailstore_ETL_pipeline_project are comparing it to the libraries listed below
Sorting:
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆22Updated 2 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆46Updated 5 years ago
- ☆21Updated last year
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- Ravi Azure ADB ADF Repository☆66Updated 4 months ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆84Updated 5 years ago
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆21Updated 2 years ago
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆161Updated 2 years ago
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆144Updated last year
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆145Updated 4 years ago
- Simple ETL pipeline using Python☆26Updated 2 years ago
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Updated last year
- ☆40Updated 10 months ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆38Updated last year
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆98Updated 10 months ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆25Updated 2 years ago
- Repository related to Spark SQL and Pyspark using Python3☆38Updated 2 years ago
- Udacity Data Engineering Nanodegree Capstone Project☆36Updated 5 years ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆95Updated 2 months ago
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 5 years ago
- ☆87Updated 2 years ago
- ☆23Updated 2 years ago
- YouTube tutorial project☆103Updated last year
- ☆28Updated last year
- Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…☆56Updated 2 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆23Updated 2 years ago
- Data Engineer with Python lecture notes from #datacamp.☆46Updated 4 years ago
- ☆34Updated 2 years ago
- This is an all-in-one repository for Data Engineers, ideal for beginners & interview preparation, which includes Python as the main Progr…☆29Updated 2 years ago
- ☆51Updated last year