priye-1 / Real_time_End_to_End_Pipeline_using_Kafka

Related projects: ⓘ

• priye-1 / airflow_data_pipeline
  ☆16Updated last year
• ArpiteshSrivastava / spotify-data-engineering-project
  In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…
  ☆21Updated last year
• vinamrgrover / ETL-Pipeline-Airflow-Reddit-API
  ☆23Updated last year
• Sourav692 / Bigdata-Interview-Preparation-Guide
  ☆13Updated this week
• sidharth1805 / Spotify_etl
  ☆123Updated last year
• darshilparmar / twitter-airflow-data-engineering-project
  YouTube tutorial project
  ☆93Updated 11 months ago
• im-nsk / Building-an-Automated-Weather-Data-Pipeline-with-Airflow-From-Ingestion-to-Data-Warehouse
  This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…
  ☆20Updated last year
• sparsh-ai / recohut
  Recohut - Learn data engineering, data science
  ☆93Updated last year
• darshilparmar / dataengineering-youtube-analysis-project
  Data Engineering YouTube Analysis Project by Darshil Parmar
  ☆133Updated 9 months ago
• mharty3 / data_engineering_zoomcamp_2022
  ☆30Updated 2 years ago
• PacktPublishing / Data-Engineering-with-AWS-2nd-edition
  Data Engineering with AWS, 2nd edition - Published by Packt
  ☆95Updated 10 months ago
• ABZ-Aaron / DataEngineerZoomCamp
  I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.
  ☆95Updated 2 years ago
• andrem8 / surf_dash
  ☆124Updated 2 years ago
• EdidiongEsu / capital_bikeshare
  ☆14Updated 5 months ago
• darshilparmar / python-for-data-engineering
  This repo contains all the code used in the Python for Data Engineering Course
  ☆205Updated 4 months ago
• rritec / Cloud-Data-Engineering
  Azure Data Factory
  ☆46Updated last week
• JesusAcuna / data-engineering-project
  ☆27Updated 10 months ago
• carbotton / IBMDataEngineeringCoursera
  IBM Data Engineering Courses from Coursera
  ☆67Updated last year
• darshilparmar / apache-spark-with-data-bricks-for-data-engineering
  apache-spark-with-databricks-for-data-engineering
  ☆47Updated 2 months ago
• SourabhSinghRana / real-time_crypto_data_pipeline_using_kafka
  I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…
  ☆28Updated last year
• raveendratal / PysparkRaveendra
  Git Repository
  ☆125Updated 11 months ago
• afaqueahmad7117 / spark-experiments
  Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews
  ☆57Updated 4 months ago
• data-engineering-community / data-engineering-project-template
  This is a template you can use for your next data engineering portfolio project.
  ☆151Updated 3 years ago
• darshilparmar / stock-market-kafka-data-engineering-project
  ☆168Updated last year
• AnandDedha / aws-airflow-dataengineering-pipeline
  ☆16Updated 8 months ago
• srikantaghosh / Data-Engineering-Spotify-End-to-End-
  Spotify data pipeline: Extract, transform, and analyze using AWS, Lambda, Glue, Athena, and S3.
  ☆13Updated last year
• itversity / spark-sql-and-pyspark-using-python3
  Repository related to Spark SQL and Pyspark using Python3
  ☆36Updated 2 years ago
• Amrit-Hub / Databricks-Certified-Data-Engineer-Professional-Questions
  This repo contains "Databricks Certified Data Engineer Professional" Questions and related docs.
  ☆27Updated last month
• DataTalksClub / zoomcamp-analytics
  Public data and analytics for our open course
  ☆29Updated 5 months ago
• katiehuangx / data-engineering
  ☆16Updated 6 months ago