SciDriver / spark-mpiLinks
MPI-oriented extension of the Spark computational model
☆24Updated 7 years ago
Alternatives and similar repositories for spark-mpi
Users that are interested in spark-mpi are comparing it to the libraries listed below
Sorting:
- Alchemist: an Apache Spark<->MPI interface☆26Updated 7 years ago
- Automatic offload of user-written Spark kernels to accelerators☆18Updated 8 years ago
- CUDA kernel and JNI code which is called by Apache Spark's MLlib.☆19Updated 9 years ago
- Spark GPU and SIMD Support☆61Updated 4 years ago
- launching and controlling spark on hpc clusters☆23Updated 2 years ago
- A primal-dual framework for distributed L1-regularized optimization☆36Updated 9 years ago
- crumbling large graphs into connected components☆12Updated 7 years ago
- Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark☆42Updated 4 years ago
- Yggdrasil: Faster Decision Trees Using Column Partitioning in Spark☆31Updated 7 years ago
- Spark MLlib code optimized to efficiently support sparse data☆51Updated 8 years ago
- GPU* or SPARK* branches are used for generating GPU code in Tungsten/concact:@kiszk, MLlib branch is used for CUDA-MLlib project/concact:…☆48Updated 8 years ago
- Benchmarks of BLAS libraries with Scala interface☆30Updated 9 years ago
- Provides GPU awareness to Spark, Contact: @kmadhugit and @kiszk☆171Updated 6 years ago
- Code to allow running BIDMach on Spark including HDFS integration and lightweight sparse model updates (Kylix).☆15Updated 4 years ago
- [ARCHIVED] C GPU DataFrame Library☆139Updated 6 years ago
- Running MPICH2 on Yarn☆114Updated 7 years ago
- Distributed Matrix Library☆72Updated 8 years ago
- A composable framework for fast and scalable data analytics☆57Updated 2 years ago
- Drizzle integration with Apache Spark☆120Updated 6 years ago
- GPU Acceleration for Apache Spark☆34Updated 9 years ago
- Distributed lbfgs on Apache Spark☆10Updated 4 years ago
- Additional useful algorithms that can be used with spark.☆24Updated 10 years ago
- Scala implementation of Histogrammar, with optional front-ends and back-ends as separate Maven projects.☆15Updated last year
- Java read and write example for Apache Arrow☆33Updated 7 years ago
- Fast I/O plugins for Spark☆41Updated 4 years ago
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆50Updated last year
- Routines and data structures for using isarn-sketches idiomatically in Apache Spark☆29Updated last year
- Library for organizing batch processing pipelines in Apache Spark☆41Updated 8 years ago
- Example for experimenting with how JupyterHub can be configured to work with Kerberos☆33Updated 7 years ago
- Machine Learning Toolkit for Extreme Scale (MaTEx)☆110Updated 6 years ago