Apache (Py)Spark type annotations (stub files).
☆118Aug 17, 2022Updated 4 years ago
Alternatives and similar repositories for pyspark-stubs
Users that are interested in pyspark-stubs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Asynchronous actions for PySpark☆46Dec 2, 2021Updated 4 years ago
- Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks☆358Jun 6, 2017Updated 9 years ago
- Schema Registry integration for Apache Spark☆40Nov 16, 2022Updated 3 years ago
- A pyspark lib to validate data quality☆19Nov 11, 2022Updated 3 years ago
- pyspark methods to enhance developer productivity 📣 👯 🎉☆690Oct 25, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- pytest plugin to run the tests with support of pyspark☆87May 21, 2025Updated last year
- Helpers & syntactic sugar for PySpark.☆62Sep 11, 2026Updated last month
- Manage Apache Atlas and Ranger configuration for your Hadoop environment.☆16May 4, 2021Updated 5 years ago
- Jupyter magics and kernels for working with remote Spark clusters☆1,369Sep 9, 2025Updated last year
- Mirror of Apache Toree (Incubating)☆750Oct 30, 2026Updated last week
- Filling in the Spark function gaps across APIs☆50Apr 14, 2021Updated 5 years ago
- Integration tests for Spark☆67May 20, 2023Updated 3 years ago
- Spark style guide☆271Sep 30, 2024Updated 2 years ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,535Dec 2, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A toolset to streamline running spark python on EMR☆20Nov 16, 2016Updated 9 years ago
- A Hivemall wrapper for Spark☆31Apr 21, 2016Updated 10 years ago
- Base classes to use when writing tests with Spark☆1,554Updated this week
- Spark functions to run popular phonetic and string matching algorithms☆61Feb 22, 2022Updated 4 years ago
- JupyterLab Notebook for Mesosphere DC/OS☆11Aug 6, 2019Updated 7 years ago
- LSM-Tree based storage engine used by FOIVER system.☆13Aug 4, 2025Updated last year
- PySpark for ETL jobs including lineage to Apache Atlas in one script via code inspection☆17Jan 12, 2017Updated 9 years ago
- Spark-based approximate nearest neighbor search using locality-sensitive hashing☆103Jul 5, 2016Updated 10 years ago
- sparkql: Apache Spark SQL DataFrame schema management for sensible humans☆12Sep 18, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆73Nov 9, 2023Updated 2 years ago
- Real-world Spark pipelines examples☆82Feb 27, 2018Updated 8 years ago
- Lightweight proxy to expose the UI of an Apache Spark cluster that is behind a firewall☆99Jul 12, 2020Updated 6 years ago
- A curated list of awesome Apache Spark packages and resources.☆1,905Feb 27, 2026Updated 8 months ago
- An sbt plugin for deploying code to Databricks Cloud☆71Jul 8, 2018Updated 8 years ago
- Apache Spark on Kubernetes☆19Mar 19, 2017Updated 9 years ago
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆833Oct 16, 2026Updated 3 weeks ago
- A boilerplate for writing PySpark Jobs☆392Jan 21, 2024Updated 2 years ago
- A tool for running Spark on Google Compute Engine☆16Jan 20, 2017Updated 9 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆12May 16, 2018Updated 8 years ago
- SparklingGraph provides easy to use set of features that will give you ability to proces large scala graphs using Spark and GraphX.☆154Jul 31, 2020Updated 6 years ago
- Accelerate the use of Databricks for customers [public repo]☆15Dec 4, 2019Updated 6 years ago
- Koalas: pandas API on Apache Spark☆3,371Mar 20, 2024Updated 2 years ago
- A simple example for PySpark based project.☆11Jun 3, 2016Updated 10 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Oct 18, 2023Updated 3 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆192Oct 15, 2025Updated last year