Fundamentals of Spark with Python (using PySpark), code examples
☆365Oct 29, 2022Updated 3 years ago
Alternatives and similar repositories for Spark-with-Python
Users that are interested in Spark-with-Python are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark (PySpark) Practice on Real Data☆270Jan 31, 2020Updated 6 years ago
- Code examples on Apache Spark using python☆108Aug 11, 2022Updated 4 years ago
- Pyspark RDD, DataFrame and Dataset Examples in Python language☆1,369Dec 7, 2025Updated 9 months ago
- (Python, PySpark)☆10Nov 15, 2020Updated 5 years ago
- Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks☆1,660Mar 16, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- PySpark-Tutorial provides basic algorithms using PySpark☆1,279May 26, 2025Updated last year
- Code snippets and tutorials for working with social science data in PySpark☆414Aug 11, 2017Updated 9 years ago
- Building simple ML apps with Streamlit☆24Apr 17, 2021Updated 5 years ago
- Basic TensorFlow mechanics, operations, class definitions, and neural networks building. Examples from deeplearning.ai Tensorflow course …☆35Apr 12, 2019Updated 7 years ago
- Implementing best practices for PySpark ETL jobs and applications.☆2,118Jan 1, 2023Updated 3 years ago
- PySpark Code for Hands-on Learners☆117Nov 3, 2019Updated 6 years ago
- Getting start with PySpark and MLlib☆299May 7, 2018Updated 8 years ago
- PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster☆498Oct 15, 2024Updated last year
- Code repository for Learning PySpark by Packt☆345Jan 30, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🐍 Quick reference guide to common patterns & functions in PySpark.☆701Feb 21, 2023Updated 3 years ago
- This repo contains commands that data engineers use in day to day work.☆64Feb 4, 2023Updated 3 years ago
- Code base for the Learning PySpark book (in preparation)☆629Apr 16, 2019Updated 7 years ago
- PySpark functions and utilities with examples. Assists ETL process of data modeling☆103Dec 3, 2020Updated 5 years ago
- ☆20Aug 17, 2019Updated 7 years ago
- Apache Spark 3 - Spark Programming in Python for Beginners☆519Jul 25, 2024Updated 2 years ago
- Jupyter notebooks for pyspark tutorials given at University☆111Aug 16, 2026Updated last month
- Course on Udemy by Jose Portilla☆96Jan 17, 2018Updated 8 years ago
- ETL (Extract, Transform and Load) with the Spark Python API (PySpark) and Hadoop Distributed File System (HDFS)☆17Dec 18, 2018Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Notes on Apache Spark (pyspark)☆299Mar 3, 2019Updated 7 years ago
- ETL pipeline using pyspark (Spark - Python)☆118Apr 4, 2020Updated 6 years ago
- Collection of Databricks and Jupyter Notebooks☆22Feb 9, 2026Updated 7 months ago
- This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language☆564Mar 20, 2024Updated 2 years ago
- This repository hosts the code/projects/demos/slides for Big Data technologies under Apache Hadoop and Apache Spark umbrella.☆42Aug 20, 2022Updated 4 years ago
- Various useful data structures in Python☆38Nov 14, 2019Updated 6 years ago
- Code repo for Packt course I developed, "Beginning Data Wrangling with Python"☆32May 21, 2020Updated 6 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Jan 22, 2019Updated 7 years ago
- LearningApacheSpark☆247Jan 3, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Repository used for Spark Trainings☆54Apr 21, 2023Updated 3 years ago
- Movie recommender system with Collaborative Filtering using PySpark☆28Apr 17, 2017Updated 9 years ago
- Practice and tutorial-style notebooks covering wide variety of machine learning techniques☆3,329May 22, 2023Updated 3 years ago
- ☆19Sep 1, 2026Updated 2 weeks ago
- Introduction to Pandas, Scikit-Learn and Keras☆14Aug 27, 2019Updated 7 years ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆92Jul 17, 2019Updated 7 years ago
- Code for my presentation: Using PySpark to Process Boat Loads of Data☆20Oct 20, 2017Updated 8 years ago