iakovoskritikos / Data-Engineering
This is an all-in-one repository for Data Engineers, ideal for beginners & interview preparation, which includes Python as the main Programing language incorporating MySQL, MongoDB and Docker
☆26Updated last year
Alternatives and similar repositories for Data-Engineering:
Users that are interested in Data-Engineering are comparing it to the libraries listed below
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆102Updated 8 months ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆21Updated last year
- This repo contains all the code used in the Python for Data Engineering Course☆244Updated 9 months ago
- ☆130Updated 2 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆10Updated last year
- data-warehouse-snowflake-for-data-engineering☆14Updated last year
- ☆26Updated 2 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆99Updated 4 years ago
- ☆145Updated 2 years ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆80Updated 5 years ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆110Updated 5 months ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆43Updated 5 years ago
- ☆44Updated last year
- Recohut - Learn data engineering, data science☆95Updated last year
- YouTube tutorial project☆99Updated last year
- This repo is mostly created for pyspark and hive related interview questions.☆46Updated 3 years ago
- Repository related to Spark SQL and Pyspark using Python3☆37Updated 2 years ago
- Ravi Azure ADB ADF Repository☆65Updated this week
- ☆28Updated last year
- Git Repository☆133Updated 2 months ago
- ☆19Updated last year
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆100Updated 2 years ago
- All Data Engineering notebooks from Datacamp course☆114Updated 5 years ago
- PySpark Projects☆24Updated last week
- ☆23Updated last year
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆106Updated 2 years ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆21Updated 2 years ago
- Simple ETL pipeline using Python☆25Updated last year
- Resources for the free AWS Data Engineering course on youtube☆99Updated 3 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29Updated last year