minhky2185 / healthcare_data_pipelineLinks
An end-to-end data pipeline for building Data Lake and supporting report using Apache Spark.
☆14Updated 2 years ago
Alternatives and similar repositories for healthcare_data_pipeline
Users that are interested in healthcare_data_pipeline are comparing it to the libraries listed below
Sorting:
- YouTube tutorial project☆105Updated last year
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆23Updated 3 years ago
- ☆21Updated 2 years ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆155Updated last year
- Data Engineering and Data Analysis, as a new hire being tested by the boss, using SQL databases.☆15Updated 2 years ago
- ☆204Updated 2 years ago
- This repo contains all code and data for WWCode Python DE workshop Aug 18 and 25 2022☆24Updated 3 years ago
- ☆44Updated last year
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆102Updated 5 months ago
- ☆35Updated 2 years ago
- This repo contains my projects from the Udacity Data Engineering Nano degree☆13Updated 2 years ago
- This repo contains all the code used in the Python for Data Engineering Course☆310Updated last year
- Data Engineering YouTube Analysis Project by Darshil Parmar☆203Updated last year
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆42Updated last year
- ☆68Updated last month
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆164Updated last week
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆24Updated 2 years ago
- My current data engineering portfolio. Includes projects spanning ETL, orchestration and dashboarding.☆116Updated last year
- ☆289Updated last year
- ☆42Updated last year
- Airflow Tutorials☆25Updated 4 years ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆41Updated last year
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆104Updated 4 years ago
- ☆142Updated 2 years ago
- End-to-end ELT data engineering project☆22Updated 2 years ago
- ☆79Updated 9 months ago
- Data Engineering with AWS, 2nd edition - Published by Packt☆153Updated last year
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆155Updated 5 years ago
- This project introduces PySpark, a powerful open-source framework for distributed data processing. We explore its architecture, component…☆34Updated 11 months ago
- Data Science Capstone Project Using Python and Tableau 10☆52Updated 2 years ago