yugokato / Spark-and-Kafka_IoT-Data-Processing-and-Analytics
Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time
☆69Updated 8 years ago
Alternatives and similar repositories for Spark-and-Kafka_IoT-Data-Processing-and-Analytics:
Users that are interested in Spark-and-Kafka_IoT-Data-Processing-and-Analytics are comparing it to the libraries listed below
- ☆19Updated 6 years ago
- ETL pipeline using pyspark (Spark - Python)☆112Updated 4 years ago
- PySpark-ETL☆23Updated 5 years ago
- ☆148Updated 6 years ago
- Apche Spark Structured Streaming with Kafka using Python(PySpark)☆41Updated 5 years ago
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Updated last year
- Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc☆51Updated 8 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Cloudera_Material: Study Material to help people preparing for Cloudera CCA Spark and Hadoop Developer Exam (CCA175). Feel free to collab…☆36Updated 4 years ago
- Hands-On Big Data Analytics with PySpark, Published by Packt☆35Updated 2 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆43Updated 5 years ago
- Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups☆16Updated 6 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆99Updated 4 years ago
- Counting Tweets Per User in Real-Time☆41Updated 7 years ago
- This repository hosts the code/projects/demos/slides for Big Data technologies under Apache Hadoop and Apache Spark umbrella.☆42Updated 2 years ago
- PySpark Code for Hands-on Learners☆116Updated 5 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- PySpark Cheatsheet☆36Updated 2 years ago
- PySpark Cookbook, published by Packt☆90Updated 2 years ago
- Apache Spark 3 - Structured Streaming Course Material☆121Updated last year
- Implementation of Spark code in Jupyter notebook. Topics include: RDDs and DataFrame, exploratory data analysis (EDA), handling multiple …☆29Updated 4 years ago
- All my projects on Big Data are provided☆27Updated 8 years ago
- Simple ETL pipeline using Python☆25Updated last year
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆80Updated 5 years ago
- code, labs and lectures for the course☆46Updated last year
- Twitter Sentiment Analysis using Spark and Kafka☆114Updated 5 years ago
- Code examples on Apache Spark using python☆106Updated 2 years ago
- Design/Implement stream/batch architecture on NYC taxi data | #DE☆26Updated 3 years ago
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆16Updated 5 years ago
- Because its never late to start taking notes and 'public' it...☆60Updated 2 months ago