Alternatives and similar repositories for pmem-shuffle

Users that are interested in pmem-shuffle are comparing it to the libraries listed below

• Intel-bigdata / Spark-PMoF
  Spark Shuffle Optimization with RDMA+AEP
  ☆30Updated 2 years ago
• maropu / spark-tpcds-datagen
  All the things about TPC-DS in Apache Spark
  ☆106Updated 2 years ago
• oap-project / sql-ds-cache
  Spark* plug-in for accelerating Spark* SQL performance by using cache and index at SQL data source layer.
  ☆37Updated 2 years ago
• apache / incubator-crail
  Mirror of Apache crail (Incubating)
  ☆150Updated 2 years ago
• MemVerge / splash
  Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
  ☆127Updated 6 months ago
• spcl / naos
  Naos: Serialization-free RDMA networking in Java
  ☆15Updated 3 years ago
• openucx / sparkucx
  A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
  ☆50Updated last year
• oap-project / gazelle_plugin
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆257Updated 2 years ago
• ssavvides / tpch-spark
  TPC-H queries in Apache Spark SQL using native DataFrames API
  ☆99Updated last year
• Mellanox / SparkRDMA
  This is archive of SparkRDMA project. The new repository with RDMA shuffle acceleration for Apache Spark is here: https://github.com/Nvid…
  ☆250Updated 6 years ago
• IBM / spark-tpc-ds-performance-test
  Use the TPC-DS benchmark to test Spark SQL performance
  ☆180Updated 5 years ago
• asonje / PAT
  Performance Analysis Tool
  ☆76Updated 3 weeks ago
• velox4j / velox4j
  Java bindings for https://github.com/facebookincubator/velox
  ☆27Updated this week
• electrum / ssb-dbgen
  Star Schema Benchmark dbgen
  ☆124Updated last year
• resource-disaggregation / snowset
  Snowflake dataset containing statistics for 70 million queries over 14 day period
  ☆113Updated 3 years ago
• intel / BDTK
  A modular acceleration toolkit for big data analytic engines
  ☆68Updated last year
• lhbench / lhbench
  Lakehouse storage system benchmark
  ☆75Updated 2 years ago
• opendataio / hcfsfuse
  A hadoop compatible FUSE use for all.
  ☆29Updated 9 months ago
• ehiggs / spark-terasort
  Spark Terasort
  ☆121Updated 2 years ago
• strymon-system / ds2
  DS2 is an auto-scaling controller for distributed streaming dataflows
  ☆89Updated 2 years ago
• Klarrio / open-stream-processing-benchmark
  This repository contains the code base for the Open Stream Processing Benchmark.
  ☆51Updated 3 years ago
• xskipper-io / xskipper
  An Extensible Data Skipping Framework
  ☆47Updated 5 months ago
• oap-project / Gluten-Trino
  Gluten: Plugin to Boost Trino's Performance
  ☆71Updated last year
• alibaba / cost-based-incremental-optimizer
  ☆35Updated last year
• CASP-Systems-BU / Gadget
  A Benchmark Harness for Systematic and Robust Evaluation of Streaming State Stores
  ☆17Updated last year
• intellistream / StreamProcessing_ReadingList
  stream processing reading list
  ☆69Updated 2 years ago
• oap-project / remote-shuffle
  Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…
  ☆21Updated last year
• realtime-storage-engine / flink-spillable-statebackend
  The preview version of a spillable state backend for Apache Flink
  ☆39Updated 4 years ago
• Xtra-Computing / briskstream
  A Multicore, NUMA Optimised Data Stream Processing System
  ☆38Updated 2 years ago
• NVIDIA / sparkucx
  A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer
  ☆28Updated last year