HandySpark - bringing pandas-like capabilities to Spark dataframes
☆201May 19, 2019Updated 7 years ago
Alternatives and similar repositories for handyspark
Users that are interested in handyspark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Data Exploration in PySpark made easy - Pyspark_dist_explore provides methods to get fast insights in your Spark DataFrames.☆102Aug 20, 2019Updated 7 years ago
- Koalas: pandas API on Apache Spark☆3,372Mar 20, 2024Updated 2 years ago
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆17Jan 12, 2017Updated 9 years ago
- ☆17Jan 17, 2023Updated 3 years ago
- Run FeatureTools to automate Feature Engineering distributionally on Spark.☆11Oct 11, 2018Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Jupyter magics and kernels for working with remote Spark clusters☆1,367Sep 9, 2025Updated last year
- Apache (Py)Spark type annotations (stub files).☆118Aug 17, 2022Updated 4 years ago
- Demonstrates calling a Scala UDF from Python using spark-submit with an EGG and JAR☆23Mar 3, 2020Updated 6 years ago
- Example of orchestrating dependent Databricks jobs using Airflow☆11Dec 19, 2019Updated 6 years ago
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆830May 19, 2026Updated 4 months ago
- An end-to-end Recommendation System built on Azure Databricks☆56Jul 29, 2019Updated 7 years ago
- Easy to use library to bring Tensorflow on Apache Spark☆295Oct 11, 2023Updated 3 years ago
- Anomaly Detection Pipeline on Azure Databricks☆28Jul 29, 2019Updated 7 years ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,535Dec 2, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆10Apr 16, 2020Updated 6 years ago
- GBM multicore scaling: h2o, xgboost and lightgbm on multicore and multi-socket systems☆20May 13, 2018Updated 8 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆192Oct 15, 2025Updated 11 months ago
- ☆18Feb 14, 2026Updated 8 months ago
- R tools for Individual Conditional Expectation plots, derivative ICE, partial dependence, and model-interpretability diagnostics.☆35Sep 3, 2026Updated last month
- (Deprecated) Scikit-learn integration package for Apache Spark☆1,071Dec 3, 2019Updated 6 years ago
- Demo of shiny working with echarts4r☆16Feb 18, 2020Updated 6 years ago
- Dockerized setup for testing code on realistic hadoop clusters☆26Jul 20, 2020Updated 6 years ago
- Mirror of Apache Toree (Incubating)☆750Oct 2, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆11Dec 26, 2022Updated 3 years ago
- A low-overhead sampling profiler for PySpark, that outputs Flame Graphs☆16Dec 17, 2020Updated 5 years ago
- general functions for your data .pipe()-lines.☆17Nov 8, 2023Updated 2 years ago
- AWS Spot instances for ML☆39Mar 21, 2023Updated 3 years ago
- ☆13Jan 30, 2023Updated 3 years ago
- An open source python library for automated feature engineering☆7,689Sep 11, 2026Updated last month
- Extract structured data online☆14Jan 19, 2026Updated 8 months ago
- Toolkit for Apache Spark ML for Feature clean-up, feature Importance calculation suite, Information Gain selection, Distributed SMOTE, Mo…☆191Jun 1, 2021Updated 5 years ago
- ☆52May 10, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Cloud Spanner Connector for Apache Spark☆18Oct 4, 2026Updated last week
- A spark sbt blueprint to build your own spark apps off of (for cloud native runtime, see the kube/spark examples)☆56Jun 1, 2019Updated 7 years ago
- ☆11Jul 18, 2016Updated 10 years ago
- Monitor Apache Spark from Jupyter Notebook☆172May 16, 2022Updated 4 years ago
- Project for the talk on NLP using LSTM implementation from DL4J on Spark☆20May 6, 2016Updated 10 years ago
- JupyterLab Notebook for Mesosphere DC/OS☆11Aug 6, 2019Updated 7 years ago
- PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2☆87Jan 3, 2020Updated 6 years ago