AndrejaCH / Movies-ETL
For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retrieve data from different sources, clean and transform it into a useful format and finally load the data into an SQL database where the data is ready for further analysis. The result is an established automated p…
☆27Updated 4 years ago
Alternatives and similar repositories for Movies-ETL:
Users that are interested in Movies-ETL are comparing it to the libraries listed below
- data-warehouse-snowflake-for-data-engineering☆14Updated last year
- Classwork projects and home works done through Udacity data engineering nano degree☆8Updated 3 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆43Updated 5 years ago
- Ravi Azure ADB ADF Repository☆66Updated 3 weeks ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆102Updated 4 years ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆119Updated 6 months ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆80Updated 5 years ago
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆107Updated 2 years ago
- ☆87Updated 2 years ago
- Simple ETL pipeline using Python☆25Updated last year
- ☆149Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆21Updated last year
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆10Updated last year
- ☆135Updated 2 years ago
- YouTube tutorial project☆98Updated last year
- ETL using Python in Jupyter Notebook, loading CSV, cleaning data, and saving to SQL Database.☆12Updated 4 years ago
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆106Updated 9 months ago
- With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…☆12Updated 2 years ago
- tokyo-olympic-azure-data-engineering-project☆185Updated 7 months ago
- Git Repository☆136Updated last week
- This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science t…☆52Updated last month
- PySpark Projects☆24Updated this week
- This repo contains commands that data engineers use in day to day work.☆60Updated 2 years ago
- Udacity Data Engineering Nanodegree Capstone Project☆35Updated 4 years ago
- ☆28Updated last year
- This is the first project where we worked on apache spark, In this project what we have done is that we downloaded the datasets from KAGG…☆17Updated 3 years ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆101Updated 2 years ago
- All Data Engineering notebooks from Datacamp course☆115Updated 5 years ago
- ☆19Updated last year
- ☆16Updated 3 months ago