A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
☆31Jun 5, 2024Updated 2 years ago
Alternatives and similar repositories for sparkucx
Users that are interested in sparkucx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆51Oct 30, 2023Updated 3 years ago
- This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvid…☆258May 13, 2019Updated 7 years ago
- This repository is a mirror of git://git.kernel.dk/blktrace.git☆15Jun 12, 2016Updated 10 years ago
- Thallium is a C++14 library wrapping Margo, Mercury, and Argobots and providing an object-oriented way to use these libraries.☆16May 4, 2026Updated 5 months ago
- ☆20Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Kerberos credential support for batch environments☆16Jul 24, 2024Updated 2 years ago
- ☆13Mar 3, 2025Updated last year
- ☆25Updated this week
- Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)☆1,738Updated this week
- InfiniBand fabric monitoring daemon written in Go☆32May 22, 2025Updated last year
- Patched version of dbgen☆34Feb 25, 2024Updated 2 years ago
- Mimir is a new implementation of MapReduce over MPI. Mimir inherits the core principles of existing MapReduce frameworks, such as MR-MPI,…☆21Nov 12, 2018Updated 7 years ago
- The Singularity SPANK plugin provides the users with an interface to launch an application within a Linux container.☆14Nov 4, 2025Updated 11 months ago
- Code for the "Cherry: A Distributed Task-Aware Shuffle Service for Serverless Analytics" paper for 2021 IEEE International Conference on …☆16Feb 3, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Command-line tool to retrieve information and monitor Mellanox un-managed Infiniband switches☆80Oct 23, 2026Updated last week
- The code of paper "Adversarial Label-Flipping Attack and Defense for Graph Neural Networks" (ICDM 2020)☆18Mar 19, 2021Updated 5 years ago
- Matt's Arbitrary Precision Math library - Nim wrapper☆12Jul 16, 2025Updated last year
- The NVIDIA® Accelerated IO (XLIO) software library accelerates TCP and UDP network applications by delivering high bandwidth, low latency…☆78Oct 26, 2026Updated last week
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆255Feb 21, 2023Updated 3 years ago
- Sandia OpenSHMEM is an implementation of the OpenSHMEM specification over multiple Networking APIs, including Portals 4, the Open Fabric …☆78Jul 13, 2026Updated 3 months ago
- A distributed data flow and computation system that runs on transactional messaging infrastructure☆11Oct 22, 2022Updated 4 years ago
- Utility for benchmarking changes in Spark using TPC-DS workloads☆16Jun 3, 2021Updated 5 years ago
- Naos: Serialization-free RDMA networking in Java☆17Aug 17, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Artifacts for our ASPLOS'23 paper dRAID☆31Feb 24, 2023Updated 3 years ago
- Milan is a Scala API and runtime infrastructure for building data-oriented systems, built on top of Apache Flink.☆42Apr 10, 2023Updated 3 years ago
- Simulator for HDD/SSD, derived from the CMU PDL DiskSim, with the SSD-add-on patch from Microsoft Research applied.☆15Dec 30, 2019Updated 6 years ago
- Linux Cross-Memory Attach☆106Feb 18, 2026Updated 8 months ago
- Ansible role to install an Apache ZooKeeper cluster☆12Sep 16, 2025Updated last year
- TopK Algorithms Benchmark☆10Jul 16, 2019Updated 7 years ago
- Slurm spank plugin to give each job private /tmp (and/or other dirs)☆22Oct 16, 2025Updated last year
- LLVM optimizations for PGAS programs☆14Mar 5, 2016Updated 10 years ago
- spart: a user-oriented partition info command for slurm☆24Sep 17, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆11Nov 26, 2024Updated last year
- Vector math and other CUDA helper functions for OptiX kernels☆10Oct 21, 2024Updated 2 years ago
- NVLink microbenchmark with IBM Power8 and NVIDIA P100 GPU - Master Thesis☆11Aug 23, 2017Updated 9 years ago
- CIKM 2019 EComm AI：用户行为预测数据挖掘竞赛，第一次做推荐系统相关的比赛，犯了很多错误，没有进复 赛☆13Mar 25, 2023Updated 3 years ago
- A re-implementation of Hadoop DistCP in Apache Spark☆47Dec 20, 2023Updated 2 years ago
- HDF5 Cache VOL connector for caching data on fast storage layers and moving data asynchronously to the parallel file system to hide I/O o…☆22Feb 10, 2026Updated 8 months ago
- Finding Overlapping Communities in Social Networks☆10Feb 12, 2014Updated 12 years ago