src-d / sparkpickleLinks
Pure Python implementation of reading SequenceFile-s with pickles written by Spark's saveAsPickleFile()
☆24Updated 8 years ago
Alternatives and similar repositories for sparkpickle
Users that are interested in sparkpickle are comparing it to the libraries listed below
Sorting:
- ☆40Updated 9 years ago
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆74Updated 2 years ago
- ☆161Updated 4 years ago
- Python client for Spark Jobserver Rest API☆40Updated 5 years ago
- Utilities to work with Scala/Java code with py4j☆40Updated last year
- Utilities and examples to asssist in working with PySpark and Cassandra.☆36Updated 10 years ago
- Unified interface for local and distributed ndarrays☆157Updated 7 years ago
- A simple demonstration of sub-sequence sampling as used for anomaly detection with EKG signals☆102Updated 5 years ago
- Asynchronous actions for PySpark☆48Updated 4 years ago
- Randomized SVD of large sparse matrices on Spark☆77Updated 3 years ago
- A tool and library for easily deploying applications on Apache YARN☆145Updated last year
- Official repository of Quickscorer: a fast algorithm to rank documents with additive ensembles of regression trees.☆18Updated 9 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆53Updated 7 years ago
- Distributed Streaming Quantiles (for PySpark)☆38Updated 11 years ago
- PySpark for Elastic Search☆55Updated 8 years ago
- Yggdrasil: Faster Decision Trees Using Column Partitioning in Spark☆30Updated 7 years ago
- functionstest☆33Updated 9 years ago
- Building Annoy Index on Apache Spark☆72Updated 4 years ago
- Spark Parameter Optimization and Tuning☆31Updated 7 years ago
- An Apache Spark-shell backend for IPython☆105Updated 4 years ago
- ☕⛵WIP PySpark dependency management☆22Updated 7 years ago
- Spark library for doing exploratory data analysis in a scalable way☆43Updated 9 years ago
- Machine learning evaluation database☆24Updated 7 years ago
- FluRS: A Python library for streaming recommendation algorithms☆109Updated 3 years ago
- CrowdRec reference framework☆32Updated 9 years ago
- A multi-armed bandit library for Python☆82Updated 5 years ago
- Wabbit Wappa is a full-featured Python wrapper for the Vowpal Wabbit machine learning utility.☆101Updated 8 years ago
- Lossy Counting and Sticky Sampling implementation for efficient frequency counts on data streams.☆63Updated 9 years ago
- Task Orchestration Tool Based on SWF and boto3☆39Updated 7 years ago
- Fast, accurate, lightweight, multi-core ML in Python, leveraging Vowpal Wabbit☆21Updated 7 years ago