src-d / sparkpickleLinks
Pure Python implementation of reading SequenceFile-s with pickles written by Spark's saveAsPickleFile()
☆24Updated 8 years ago
Alternatives and similar repositories for sparkpickle
Users that are interested in sparkpickle are comparing it to the libraries listed below
Sorting:
- Python client for Spark Jobserver Rest API☆40Updated 5 years ago
- ☆40Updated 9 years ago
- Utilities to work with Scala/Java code with py4j☆40Updated last year
- A framework for writing Spark 2.x applications in a pretty way☆83Updated 2 years ago
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆74Updated last year
- functionstest☆33Updated 8 years ago
- Yggdrasil: Faster Decision Trees Using Column Partitioning in Spark☆30Updated 7 years ago
- ☆162Updated 4 years ago
- A simple demonstration of sub-sequence sampling as used for anomaly detection with EKG signals☆103Updated 4 years ago
- FluRS: A Python library for streaming recommendation algorithms☆109Updated 3 years ago
- A tool and library for easily deploying applications on Apache YARN☆144Updated last year
- Building Annoy Index on Apache Spark☆72Updated 4 years ago
- Spark Parameter Optimization and Tuning☆31Updated 7 years ago
- An Apache Spark-shell backend for IPython☆105Updated 4 years ago
- Apache (Py)Spark type annotations (stub files).☆117Updated 3 years ago
- Utilities and examples to asssist in working with PySpark and Cassandra.☆36Updated 10 years ago
- Locality Sensitive Hashing for Apache Spark☆87Updated 3 years ago
- Distributed Streaming Quantiles (for PySpark)☆38Updated 11 years ago
- Space-Filling Curves in Scala☆26Updated 5 years ago
- A curated inventory of machine learning methods available on the Apache Spark platform, both in official and third party libraries.☆65Updated 8 years ago
- This toolkit provides an implementation of Modified Adsorption (MAD), a graph-based semi-supervised learning (SSL) algorithm.☆23Updated 8 years ago
- Asynchronous actions for PySpark☆47Updated 3 years ago
- A multi-armed bandit library for Python☆82Updated 5 years ago
- Sparkling Pandas☆25Updated 8 years ago
- Implementations of the Portable Format for Analytics (PFA)☆127Updated 2 years ago
- Scala/Spark implementation of Distributed Nearest Neighbours Mean Shift using LSH☆30Updated 6 years ago
- Seldon Spark Jobs☆26Updated 10 years ago
- Unified interface for local and distributed ndarrays☆157Updated 6 years ago
- Affinity Propagation on Spark☆19Updated 4 years ago
- Randomized SVD of large sparse matrices on Spark☆77Updated 3 years ago