SciDriver / spark-mpiLinks
MPI-oriented extension of the Spark computational model
☆24Updated 6 years ago
Alternatives and similar repositories for spark-mpi
Users that are interested in spark-mpi are comparing it to the libraries listed below
Sorting:
- Alchemist: an Apache Spark<->MPI interface☆26Updated 7 years ago
- Automatic offload of user-written Spark kernels to accelerators☆18Updated 8 years ago
- CUDA kernel and JNI code which is called by Apache Spark's MLlib.☆19Updated 8 years ago
- launching and controlling spark on hpc clusters☆23Updated 2 years ago
- Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark☆42Updated 4 years ago
- A primal-dual framework for distributed L1-regularized optimization☆36Updated 9 years ago
- Spark GPU and SIMD Support☆61Updated 4 years ago
- GPU Acceleration for Apache Spark☆34Updated 9 years ago
- GPU* or SPARK* branches are used for generating GPU code in Tungsten/concact:@kiszk, MLlib branch is used for CUDA-MLlib project/concact:…☆48Updated 7 years ago
- A plugin to enable Apache Spark to read HDF5 files☆20Updated 8 years ago
- ☆31Updated 5 years ago
- Kira is an astronomy image processing toolkit implemented with Apache Spark.☆15Updated 9 years ago
- HopsYARN Tensorflow Framework.☆31Updated 5 years ago
- analytics tool kit☆43Updated 8 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Updated 8 years ago
- A Real-Time Analytical Processing (RTAP) example using Spark/Shark☆51Updated 11 years ago
- Yggdrasil: Faster Decision Trees Using Column Partitioning in Spark☆31Updated 7 years ago
- The presentation at Spark Summit 2014 showing how 4Quant does production scale image processing and analysis using Spark☆17Updated 10 years ago
- Spark MLlib code optimized to efficiently support sparse data☆51Updated 8 years ago
- Provides GPU awareness to Spark, Contact: @kmadhugit and @kiszk☆171Updated 6 years ago
- Set up tools for running a few DL libraries on CDH and CDSW☆17Updated 4 years ago
- Moved to https://github.com/project-alchemist/Alchemist☆12Updated 7 years ago
- [ARCHIVED] Moved to github.com/NVIDIA/spark-xgboost-examples☆70Updated 4 years ago
- Distributed lbfgs on Apache Spark☆10Updated 4 years ago
- Additional useful algorithms that can be used with spark.☆24Updated 10 years ago
- Drizzle integration with Apache Spark☆120Updated 6 years ago
- Running MPICH2 on Yarn☆114Updated 7 years ago
- Spark implementation of the Google Correlate algorithm to quickly find highly correlated vectors in huge datasets☆93Updated 9 years ago
- A collective communication library plugined into Hadoop☆23Updated 3 years ago
- Fast I/O plugins for Spark☆41Updated 4 years ago