src-d / sparkpickle
Pure Python implementation of reading SequenceFile-s with pickles written by Spark's saveAsPickleFile()
☆24Updated 7 years ago
Related projects: ⓘ
- Machine learning evaluation database☆24Updated 6 years ago
- ☆11Updated 4 years ago
- Yggdrasil: Faster Decision Trees Using Column Partitioning in Spark☆31Updated 6 years ago
- ☆38Updated 8 years ago
- Spark library for doing exploratory data analysis in a scalable way☆43Updated 8 years ago
- This toolkit provides an implementation of Modified Adsorption (MAD), a graph-based semi-supervised learning (SSL) algorithm.☆23Updated 7 years ago
- Spark Parameter Optimization and Tuning☆31Updated 6 years ago
- An Apache Spark-shell backend for IPython☆107Updated 3 years ago
- Utilities to work with Scala/Java code with py4j☆40Updated 8 months ago
- Python client for Spark Jobserver Rest API☆39Updated 4 years ago
- Building Annoy Index on Apache Spark☆72Updated 3 years ago
- ☆32Updated 4 years ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆53Updated 6 years ago
- A simple demonstration of sub-sequence sampling as used for anomaly detection with EKG signals☆102Updated 3 years ago
- Simplified tree-based classifier and regressor for interpretable machine learning (scikit-learn compatible)☆46Updated 3 years ago
- Distributed Streaming Quantiles (for PySpark)☆37Updated 10 years ago
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆74Updated 10 months ago
- This project contains the code to translate between Apache Spark and SFrame.☆21Updated 8 years ago
- Apache Mesos backend for Dask scheduling library☆28Updated 6 years ago
- Demo code contrasting Google Dataflow (Apache Beam) with Apache Spark☆14Updated 8 years ago
- Factorization Machines on Spark and Glint☆25Updated 7 years ago
- Assembly of fundamental statistics implemented based on Apache Spark☆31Updated 8 years ago
- Collection of dask example notebooks☆57Updated 6 years ago
- Spark MLlib code optimized to efficiently support sparse data☆50Updated 7 years ago
- Machine learning enhancements to Spark MlLib☆20Updated 9 years ago
- Official repository of Quickscorer: a fast algorithm to rank documents with additive ensembles of regression trees.☆18Updated 8 years ago
- Distributed Matrix Library☆70Updated 7 years ago
- Scala/Spark implementation of Distributed Nearest Neighbours Mean Shift using LSH☆30Updated 5 years ago
- functionstest☆33Updated 7 years ago
- CrowdRec reference framework☆32Updated 7 years ago