SciDriver / spark-mpi
MPI-oriented extension of the Spark computational model
☆24Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for spark-mpi
- Alchemist: an Apache Spark<->MPI interface☆26Updated 6 years ago
- Automatic offload of user-written Spark kernels to accelerators☆18Updated 8 years ago
- launching and controlling spark on hpc clusters☆23Updated 2 years ago
- Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark☆42Updated 3 years ago
- Yggdrasil: Faster Decision Trees Using Column Partitioning in Spark☆31Updated 6 years ago
- GPU Acceleration for Apache Spark☆34Updated 9 years ago
- Spark GPU and SIMD Support☆61Updated 4 years ago
- A primal-dual framework for distributed L1-regularized optimization☆35Updated 8 years ago
- Spark MLlib code optimized to efficiently support sparse data☆50Updated 7 years ago
- CUDA kernel and JNI code which is called by Apache Spark's MLlib.☆19Updated 8 years ago
- crumbling large graphs into connected components☆12Updated 6 years ago
- GPU* or SPARK* branches are used for generating GPU code in Tungsten/concact:@kiszk, MLlib branch is used for CUDA-MLlib project/concact:…☆48Updated 7 years ago
- Provides GPU awareness to Spark, Contact: @kmadhugit and @kiszk☆172Updated 6 years ago
- Running MPICH2 on Yarn☆114Updated 7 years ago
- ☆33Updated 8 years ago
- A composable framework for fast and scalable data analytics☆57Updated last year
- JVM integration for Weld☆16Updated 6 years ago
- Library for organizing batch processing pipelines in Apache Spark☆41Updated 7 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Updated 8 years ago
- Distributed lbfgs on Apache Spark☆10Updated 4 years ago
- Benchmarks of BLAS libraries with Scala interface☆30Updated 8 years ago
- An API for Distributed Machine Learning☆154Updated 8 years ago
- analytics tool kit☆43Updated 7 years ago
- Distributed Matrix Library☆70Updated 7 years ago
- Routines and data structures for using isarn-sketches idiomatically in Apache Spark☆29Updated 5 months ago
- Additional useful algorithms that can be used with spark.☆24Updated 9 years ago
- Example for experimenting with how JupyterHub can be configured to work with Kerberos☆33Updated 7 years ago