src-d / sparkpickleLinks
Pure Python implementation of reading SequenceFile-s with pickles written by Spark's saveAsPickleFile()
☆24Updated 8 years ago
Alternatives and similar repositories for sparkpickle
Users that are interested in sparkpickle are comparing it to the libraries listed below
Sorting:
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆74Updated 2 years ago
- This toolkit provides an implementation of Modified Adsorption (MAD), a graph-based semi-supervised learning (SSL) algorithm.☆24Updated 8 years ago
- Building Annoy Index on Apache Spark☆72Updated 4 years ago
- Yggdrasil: Faster Decision Trees Using Column Partitioning in Spark☆30Updated 7 years ago
- Utilities to work with Scala/Java code with py4j☆40Updated last year
- Spark library for doing exploratory data analysis in a scalable way☆43Updated 9 years ago
- Spark Parameter Optimization and Tuning☆31Updated 7 years ago
- Distributed t-SNE via Apache Spark☆161Updated 7 years ago
- A curated inventory of machine learning methods available on the Apache Spark platform, both in official and third party libraries.☆65Updated 8 years ago
- A framework for writing Spark 2.x applications in a pretty way☆83Updated 2 years ago
- TensorFlow TFRecord reader CLI tool☆61Updated last week
- A tool and library for easily deploying applications on Apache YARN☆146Updated last year
- Python client for Spark Jobserver Rest API☆40Updated 5 years ago
- A scala-based feature generation and modeling framework☆61Updated 7 years ago
- An Apache Spark-shell backend for IPython☆105Updated 4 years ago
- Asynchronous actions for PySpark☆47Updated 3 years ago
- Scala/Spark implementation of Distributed Nearest Neighbours Mean Shift using LSH☆30Updated 6 years ago
- ☆40Updated 9 years ago
- Locality Sensitive Hashing for Apache Spark☆87Updated 3 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 7 years ago
- functionstest☆33Updated 9 years ago
- Randomized SVD of large sparse matrices on Spark☆77Updated 3 years ago
- A simple demonstration of sub-sequence sampling as used for anomaly detection with EKG signals☆103Updated 5 years ago
- PySpark for Elastic Search☆55Updated 8 years ago
- Unified interface for local and distributed ndarrays☆157Updated 7 years ago
- Machine learning evaluation database☆24Updated 7 years ago
- ☆161Updated 4 years ago
- Scala wrapper for Annoy☆59Updated 3 years ago
- A spark package for loading Spark ML models to Redis-ML☆63Updated 6 years ago
- Topic Modeling on Apache Spark☆94Updated 6 years ago