AhmetFurkanDEMIR / Data-Engineering-Project-with-HDFS-and-Kafka
Data Engineering Project with Hadoop HDFS and Kafka
☆32Updated last year
Related projects ⓘ
Alternatives and complementary repositories for Data-Engineering-Project-with-HDFS-and-Kafka
- This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science t…☆32Updated 9 months ago
- datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments☆40Updated last year
- ☆27Updated last year
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆94Updated last year
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆21Updated last year
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆70Updated 6 months ago
- For the Coursera specialization https://www.coursera.org/specializations/gcp-data-machine-learning☆37Updated 6 years ago
- Cracking Data Engineering Interview Guide, published by Packt☆33Updated last year
- ☆18Updated 10 months ago
- Simple ETL pipeline using Python☆21Updated last year
- YouTube tutorial project☆94Updated last year
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆22Updated last year
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆31Updated 11 months ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆28Updated last year
- ☆86Updated 2 years ago
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆55Updated 5 months ago
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Updated last year
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆67Updated 3 months ago
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆11Updated last year
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆35Updated last year
- data-warehouse-snowflake-for-data-engineering☆14Updated last year
- Cool DE Projects☆18Updated this week
- Final Project of the MLOps Zoomcamp hosted by DataTalksClub.☆25Updated last year
- With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…☆12Updated 2 years ago
- For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retri…☆25Updated 3 years ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆37Updated last year
- Classwork projects and home works done through Udacity data engineering nano degree☆8Updated 3 years ago
- ☆23Updated last year
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated 11 months ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆22Updated 2 years ago