A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
☆32Jun 5, 2024Updated last year
Alternatives and similar repositories for sparkucx
Users that are interested in sparkucx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆52Oct 30, 2023Updated 2 years ago
- This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvid…☆257May 13, 2019Updated 7 years ago
- ☆10Dec 12, 2023Updated 2 years ago
- Maven packaging and lifecycle for Trino plugins☆15May 8, 2026Updated 2 weeks ago
- ☆22Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Collection of scripts used for BlueField SoC system management.☆31Apr 9, 2026Updated last month
- NVIDIA Network Operator☆337May 15, 2026Updated last week
- InfiniBand fabric monitoring daemon written in Go☆32May 22, 2025Updated last year
- Kerberos credential support for batch environments☆16Jul 24, 2024Updated last year
- The Singularity SPANK plugin provides the users with an interface to launch an application within a Linux container.☆13Nov 4, 2025Updated 6 months ago
- ☆30Dec 27, 2013Updated 12 years ago
- A terminal based monitoring tool for InfiniBand networks using Detector (https://github.com/hhu-bsinfo/detector)☆15Aug 7, 2019Updated 6 years ago
- Command-line tool to retrieve information and monitor Mellanox un-managed Infiniband switches☆76Nov 17, 2025Updated 6 months ago
- Slurm Lua SPANK plugin☆18Jan 30, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- "The history of astronomy is a history of receding horizons."― Edwin Powell Hubble☆13Jan 20, 2021Updated 5 years ago
- ☆30May 7, 2017Updated 9 years ago
- LintCode python practice☆20Apr 10, 2019Updated 7 years ago
- Code for the "Cherry: A Distributed Task-Aware Shuffle Service for Serverless Analytics" paper for 2021 IEEE International Conference on …☆15Feb 3, 2022Updated 4 years ago
- Mimir is a new implementation of MapReduce over MPI. Mimir inherits the core principles of existing MapReduce frameworks, such as MR-MPI,…☆21Nov 12, 2018Updated 7 years ago
- Mellanox BlueField PKA support☆22Jan 15, 2026Updated 4 months ago
- Orchestration, Management and Monitoring of Data Processing☆11May 15, 2026Updated last week
- Milan is a Scala API and runtime infrastructure for building data-oriented systems, built on top of Apache Flink.☆43Apr 10, 2023Updated 3 years ago
- Utility for benchmarking changes in Spark using TPC-DS workloads☆16Jun 3, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Linux Cross-Memory Attach☆100Feb 18, 2026Updated 3 months ago
- HDF5 Cache VOL connector for caching data on fast storage layers and moving data asynchronously to the parallel file system to hide I/O o…☆22Feb 10, 2026Updated 3 months ago
- Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)☆1,636Updated this week
- Artifacts for our ASPLOS'23 paper dRAID☆30Feb 24, 2023Updated 3 years ago
- The most influential papers about distributed systems, databases, algorithms, and data structures☆12Apr 5, 2026Updated last month
- 运行在车载Android系统上，用于记录汽车轨迹的后台服务程序。☆14May 18, 2016Updated 10 years ago
- ☆74Nov 1, 2022Updated 3 years ago
- An example project that implements a data pipeline using Scala, Akka, and Spark and works with document-oriented and graph databases to l…☆11Aug 9, 2019Updated 6 years ago
- Froster is a user-friendly archiving tool for teams that move data between Posix file systems and S3 like object storage systems such as …☆26Nov 12, 2025Updated 6 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Naos: Serialization-free RDMA networking in Java☆17Aug 17, 2021Updated 4 years ago
- OpenSHMEM Reference Implementation over UCX for Specification 1.4 and up☆41May 19, 2023Updated 3 years ago
- TopK Algorithms Benchmark☆10Jul 16, 2019Updated 6 years ago
- Vector math and other CUDA helper functions for OptiX kernels☆10Oct 21, 2024Updated last year
- Mercury is a C library for implementing RPC, optimized for HPC.☆207Apr 28, 2026Updated 3 weeks ago
- ☆18Jul 24, 2023Updated 2 years ago
- A simple hibernate and h2 example.☆15Sep 26, 2012Updated 13 years ago