Joshua-omolewa / Retailstore_ETL_pipeline_projectLinks
Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and transforms the raw data (ETL process) using Apache spark to meet business requirements and also enables Data Analyst create Data Visualization using Superset. Airflow is used to orchestrate the pipeline
☆11Updated 2 years ago
Alternatives and similar repositories for Retailstore_ETL_pipeline_project
Users that are interested in Retailstore_ETL_pipeline_project are comparing it to the libraries listed below
Sorting:
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25Updated 2 years ago
- YouTube tutorial project☆105Updated 2 years ago
- Contains spark dataframe solutions of leetcode questions☆26Updated 2 years ago
- ☆29Updated 2 years ago
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆163Updated 2 years ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆88Updated 6 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆50Updated 6 years ago
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆177Updated 2 months ago
- All Data Engineering notebooks from Datacamp course☆115Updated 5 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- ☆209Updated 2 years ago
- Ravi Azure ADB ADF Repository☆64Updated 10 months ago
- Simple ETL pipeline using Python☆29Updated 2 years ago
- PySpark Projects☆27Updated last week
- The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …☆122Updated 3 years ago
- Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…☆57Updated 3 years ago
- ☆142Updated 2 years ago
- Price Crawler - Tracking Price Inflation☆187Updated 5 years ago
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 6 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆158Updated 5 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆28Updated 2 years ago
- ☆36Updated 2 years ago
- Udacity Data Engineering Nanodegree Capstone Project☆36Updated 5 years ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆209Updated last year
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Updated 4 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆103Updated 2 months ago
- ☆22Updated 2 years ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆108Updated 3 years ago
- ☆161Updated 3 years ago
- ☆21Updated last year