A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
☆32Jun 5, 2024Updated last year
Alternatives and similar repositories for sparkucx
Users that are interested in sparkucx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer☆52Oct 30, 2023Updated 2 years ago
- This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvid…☆257May 13, 2019Updated 6 years ago
- ☆10Dec 12, 2023Updated 2 years ago
- Oak Ridge OpenSHMEM Benchmarks☆15Jun 26, 2018Updated 7 years ago
- ☆22Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Source code for VLDB 2015 paper "The More the Merrier: Efficient Multi-Source Graph Traversal"☆26Sep 22, 2015Updated 10 years ago
- ☆13Mar 3, 2025Updated last year
- Kerberos credential support for batch environments☆16Jul 24, 2024Updated last year
- Slurm Lua SPANK plugin☆17Jan 30, 2025Updated last year
- ☆30May 7, 2017Updated 8 years ago
- Code for the "Cherry: A Distributed Task-Aware Shuffle Service for Serverless Analytics" paper for 2021 IEEE International Conference on …☆15Feb 3, 2022Updated 4 years ago
- LintCode python practice☆20Apr 10, 2019Updated 7 years ago
- Milan is a Scala API and runtime infrastructure for building data-oriented systems, built on top of Apache Flink.☆42Apr 10, 2023Updated 3 years ago
- Utility for benchmarking changes in Spark using TPC-DS workloads☆16Jun 3, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Linux Cross-Memory Attach☆98Feb 18, 2026Updated last month
- Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)☆1,603Apr 5, 2026Updated last week
- Simulator for HDD/SSD, derived from the CMU PDL DiskSim, with the SSD-add-on patch from Microsoft Research applied.☆15Dec 30, 2019Updated 6 years ago
- 运行在车载Android系统上，用于记录汽车轨迹的后台服务程序。☆14May 18, 2016Updated 9 years ago
- An example project that implements a data pipeline using Scala, Akka, and Spark and works with document-oriented and graph databases to l…☆11Aug 9, 2019Updated 6 years ago
- A prototyping environment that runs an emulated NVMe device☆13Oct 6, 2017Updated 8 years ago
- Naos: Serialization-free RDMA networking in Java☆17Aug 17, 2021Updated 4 years ago
- Thallium is a C++14 library wrapping Margo, Mercury, and Argobots and providing an object-oriented way to use these libraries.☆14Apr 3, 2026Updated last week
- Apache Hive☆13Jan 3, 2021Updated 5 years ago
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- Function Message Interface (FMI): library for message-passing and collective communication for serverless functions.☆22Apr 16, 2024Updated last year
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,042Updated this week
- ☆18Jul 24, 2023Updated 2 years ago
- Finding Overlapping Communities in Social Networks☆10Feb 12, 2014Updated 12 years ago
- spart: a user-oriented partition info command for slurm☆24Sep 17, 2023Updated 2 years ago
- Locality-Sensitive Hashing for Minhash Signatures☆12Sep 12, 2013Updated 12 years ago
- ☆43May 16, 2024Updated last year
- Ansible role to install an Apache ZooKeeper cluster☆12Sep 16, 2025Updated 6 months ago
- NVIDIA's launch, startup, and logging scripts used by our MLPerf Training and HPC submissions☆39Sep 12, 2025Updated 7 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Storage Engine for block and key/value stores.☆25Updated this week
- This is a plugin which lets EC2 developers use libfabric as network provider while running NCCL applications.☆210Updated this week
- Transparent acceleration for Java NIO applications via UCX☆23Jan 9, 2026Updated 3 months ago
- Query engine synthesizer based on, our domain-specific language, VOILA☆13Mar 2, 2021Updated 5 years ago
- The code for both the framework and experiments from the NSDI '19 paper "Loom: Flexible and Efficient NIC Packet Scheduling"☆31Feb 4, 2019Updated 7 years ago
- NVMe-oF Target Configuration Utility for Linux☆14Updated this week
- LEMON: A local algorithm for fast, high-precision overlapping community detection☆55Sep 28, 2017Updated 8 years ago