src-d / sparkpickle
Pure Python implementation of reading SequenceFile-s with pickles written by Spark's saveAsPickleFile()
☆24Updated 7 years ago
Alternatives and similar repositories for sparkpickle:
Users that are interested in sparkpickle are comparing it to the libraries listed below
- Spark MLlib code optimized to efficiently support sparse data☆51Updated 8 years ago
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆74Updated last year
- A tool and library for easily deploying applications on Apache YARN☆143Updated last year
- Spark library for doing exploratory data analysis in a scalable way☆43Updated 9 years ago
- Locality Sensitive Hashing for Apache Spark☆87Updated 3 years ago
- Distributed Matrix Library☆71Updated 8 years ago
- Python client for Spark Jobserver Rest API☆39Updated 5 years ago
- Demo code contrasting Google Dataflow (Apache Beam) with Apache Spark☆14Updated 8 years ago
- This toolkit provides an implementation of Modified Adsorption (MAD), a graph-based semi-supervised learning (SSL) algorithm.☆23Updated 7 years ago
- Wabbit Wappa is a full-featured Python wrapper for the Vowpal Wabbit machine learning utility.☆101Updated 7 years ago
- Yggdrasil: Faster Decision Trees Using Column Partitioning in Spark☆31Updated 6 years ago
- ☆39Updated 8 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- functionstest☆33Updated 8 years ago
- Randomized SVD of large sparse matrices on Spark☆77Updated 2 years ago
- Ranking algorithms for Spark machine learning pipeline☆15Updated 7 years ago
- Training materials for Strata, AMP Camp, etc☆149Updated 9 years ago
- MLeap allows for easily putting Spark ML pipelines into production☆78Updated 8 years ago
- A library that allows serialization of SciKit-Learn estimators into PMML☆70Updated 5 years ago
- Utilities to work with Scala/Java code with py4j☆40Updated last year
- ☆111Updated 8 years ago
- Spark Extension : ML transformers, SQL aggregations, etc that are missing in Apache Spark☆147Updated 9 years ago
- This is an introduction of Apache Spark DataFrames.☆41Updated 10 years ago
- A curated inventory of machine learning methods available on the Apache Spark platform, both in official and third party libraries.☆65Updated 8 years ago
- Seldon Spark Jobs☆26Updated 10 years ago
- Machine learning evaluation database☆24Updated 7 years ago
- Apache Mesos backend for Dask scheduling library☆28Updated 7 years ago
- Machine learning enhancements to Spark MlLib☆20Updated 10 years ago
- Spark ML Lib serving library☆48Updated 6 years ago
- Building Annoy Index on Apache Spark☆72Updated 4 years ago