Alternatives and similar repositories for SparkRDMA

Users that are interested in SparkRDMA are comparing it to the libraries listed below

• zrlio / disni

  View on GitHub
  DiSNI: Direct Storage and Networking Interface
  ☆194Mar 9, 2023Updated 2 years ago
• apache / incubator-crail

  View on GitHub
  Mirror of Apache crail (Incubating)
  ☆151Jul 3, 2022Updated 3 years ago
• zrlio / crail-spark-io

  View on GitHub
  Fast I/O plugins for Spark
  ☆41Dec 14, 2020Updated 5 years ago
• zrlio / darpc

  View on GitHub
  DaRPC: Data Center Remote Procedure Call
  ☆56Oct 13, 2020Updated 5 years ago
• NVIDIA / sparkucx

  View on GitHub
  A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
  ☆32Jun 5, 2024Updated last year
• Intel-bigdata / Spark-PMoF

  View on GitHub
  Spark Shuffle Optimization with RDMA+AEP
  ☆30May 23, 2023Updated 2 years ago
• zrlio / crail

  View on GitHub
  [Archived] A Fast Multi-tiered Distributed Storage System based on User-Level I/O
  ☆74Mar 2, 2018Updated 7 years ago
• openucx / sparkucx

  View on GitHub
  A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
  ☆52Oct 30, 2023Updated 2 years ago
• ehiggs / spark-terasort

  View on GitHub
  Spark Terasort
  ☆121Apr 21, 2023Updated 2 years ago
• spcl / naos

  View on GitHub
  Naos: Serialization-free RDMA networking in Java
  ☆17Aug 17, 2021Updated 4 years ago
• efficient / rdma_bench

  View on GitHub
  A framework to understand RDMA
  ☆407Oct 12, 2023Updated 2 years ago
• accelio / JXIO

  View on GitHub
  Java API over Accelio
  ☆84Jan 15, 2017Updated 9 years ago
• Mellanox / libvma

  View on GitHub
  Linux user space library for network socket acceleration based on RDMA compatible network adaptors
  ☆676Feb 8, 2026Updated last week
• WukLab / LITE

  View on GitHub
  LITE Kernel RDMA Support for Datacenter Applications. SOSP 2017.
  ☆111Jul 9, 2020Updated 5 years ago
• MemVerge / splash

  View on GitHub
  Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
  ☆130Dec 19, 2024Updated last year
• fengruotj / RDMAFileTransfer

  View on GitHub
  RDMA Large File Transfer：A Large-scale File and Folder Transfer Framework. By using two components, RDMA Channel and RDMA Verbs.
  ☆14Jan 9, 2020Updated 6 years ago
• jcxue / RDMA-Tutorial

  View on GitHub
  A tutorial on RDMA based programming using code examples
  ☆597Jan 3, 2020Updated 6 years ago
• efficient / HERD

  View on GitHub
  ☆68May 1, 2017Updated 8 years ago
• openucx / ucx

  View on GitHub
  Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)
  ☆1,573Updated this week
• oap-project / gazelle_plugin

  View on GitHub
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆258Feb 21, 2023Updated 2 years ago
• Intel-bigdata / HPNL

  View on GitHub
  High Performance Network Library for RDMA
  ☆28Jan 3, 2023Updated 3 years ago
• zrlio / jNVMf

  View on GitHub
  A NVMf library for Java
  ☆30Aug 15, 2019Updated 6 years ago
• SJTU-IPADS / drtmh

  View on GitHub
  Fast In-memory Transaction Processing using Hybrid RDMA Primitives
  ☆66Nov 15, 2018Updated 7 years ago
• UrbanOS-Public / kdp

  View on GitHub
  Kubernetes deployment of PrestoDB, Hive Metastore, and Minio S3-standard object store
  ☆17Oct 20, 2022Updated 3 years ago
• mellanox-hpc / ibverbs-tests

  View on GitHub
  OFED libibverbs tests package
  ☆16Oct 5, 2021Updated 4 years ago
• hvanhovell / weld-java

  View on GitHub
  JVM integration for Weld
  ☆16Sep 24, 2018Updated 7 years ago
• IBM / spark-tpc-ds-performance-test

  View on GitHub
  Use the TPC-DS benchmark to test Spark SQL performance
  ☆184Apr 27, 2020Updated 5 years ago
• apache / carbondata

  View on GitHub
  High performance data store solution
  ☆1,446Jan 21, 2026Updated 3 weeks ago
• tensorflow / networking

  View on GitHub
  Enhanced networking support for TensorFlow. Maintained by SIG-networking.
  ☆98Nov 19, 2021Updated 4 years ago
• alexjbush / ansible-hadoop-asap

  View on GitHub
  Ansible playbook for automated HDP 2.x deployment install with Kerberos
  ☆19Sep 8, 2016Updated 9 years ago
• asonje / PAT

  View on GitHub
  Performance Analysis Tool
  ☆78Nov 25, 2025Updated 2 months ago
• ofiwg / librdmacm

  View on GitHub
  ☆76Sep 13, 2016Updated 9 years ago
• SymbioticLab / Infiniswap

  View on GitHub
  Infiniswap enables unmodified applications to efficiently use disaggregated memory.
  ☆256Sep 26, 2020Updated 5 years ago
• Intel-bigdata / SSM

  View on GitHub
  Smart Storage Management for Big Data, a comprehensive hot/cold data optimized solution
  ☆140Jan 3, 2023Updated 3 years ago
• Mellanox / rdma_fc

  View on GitHub
  Demonstration of flow control over RDMA fabric
  ☆13Jun 28, 2018Updated 7 years ago
• lightbend / flink-operator

  View on GitHub
  Helm Chart for lyft/flinkk8soperator
  ☆11Mar 10, 2020Updated 5 years ago
• CGCL-codes / Tensorflow-RDMA

  View on GitHub
  Tensorflow is a computational library using data flow graphs for scalable machine learning, and Tensorflow-RDMA is the implementation ov…
  ☆59Nov 27, 2022Updated 3 years ago
• linux-rdma / perftest

  View on GitHub
  Infiniband Verbs Performance Tests
  ☆910Jan 11, 2026Updated last month
• banzaicloud / spark-metrics

  View on GitHub
  Spark metrics related custom classes and sinks (e.g. Prometheus)
  ☆186Aug 2, 2022Updated 3 years ago