DIYBigData / spark-data-analysis-projects
A collection of data analysis projects done using PySpark via Jupyter notebooks.
☆10Updated 2 years ago
Alternatives and similar repositories for spark-data-analysis-projects:
Users that are interested in spark-data-analysis-projects are comparing it to the libraries listed below
- Pyspark in Google Colab: A simple machine learning (Linear Regression) model☆36Updated 5 years ago
- PySpark, Databrick, h2o, MLlib☆18Updated 8 years ago
- A Scalable Data Cleaning Library for PySpark.☆26Updated 5 years ago
- My presentation at ODSC India 2018 about Deep Learning with Apache Spark☆27Updated 6 years ago
- Spark NLP for Streamlit☆15Updated 3 years ago
- Python Machine Learning (ML) project that demonstrates the archetypal ML workflow within a Jupyter notebook, with automated model deploym…☆60Updated last year
- Predict whether a loan will be repaid using automated feature engineering.☆63Updated last year
- Code for my presentation: Using PySpark to Process Boat Loads of Data☆20Updated 7 years ago
- ☆19Updated 6 years ago
- Learning from multiple companies in Silicon Valley. Netflix, Facebook, Google, Startups☆16Updated 6 years ago
- Work for Mastering Large Datasets with Python☆18Updated 2 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆55Updated 6 years ago
- Analytics projects using Big Data eco-systems (Hadoop, Spark, Storm)☆16Updated 3 years ago
- Develop ML models predict taxi trip duration in NYC. Ranked : Top 6% | RMSLE : 0.377 (Kaggle) | #DS☆17Updated 2 years ago
- Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc☆51Updated 8 years ago
- Insurance fraud claims analysis project☆51Updated last year
- Spark and Python (PySpark) Examples☆40Updated 3 years ago
- PySpark Cookbook, published by Packt☆90Updated last year
- Code repository for Large Scale Machine Learning with Spark by Packt☆20Updated 2 years ago
- code, labs and lectures for the course☆46Updated last year
- Contains code and presentation for my interactive hack session, 'Effective Feature Engineering: A Structured Approach to Building Better …☆30Updated 4 years ago
- Tips for Advanced Feature Engineering☆52Updated 4 years ago
- Powerful rapid automatic EDA and feature engineering library with a very easy to use API 🌟☆53Updated 3 years ago
- A lightweight benchmark utility for PySpark☆17Updated 4 years ago
- Jupyter notebooks for pyspark tutorials given at University☆107Updated last month
- Analytics for building Customer Journey Map in Ecommerce☆28Updated 5 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- PySpark Code for Hands-on Learners☆116Updated 5 years ago
- pyspark dataframe made easy☆16Updated 3 years ago
- Udacity Data Streaming Nanodegree Program☆22Updated 3 years ago