Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
☆262May 12, 2024Updated last year
Alternatives and similar repositories for CloudShuffleService
Users that are interested in CloudShuffleService are comparing it to the libraries listed below
Sorting:
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,039Updated this week
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆445Updated this week
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆257Apr 7, 2023Updated 2 years ago
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,521Updated this week
- Remote Shuffle Service for Flink☆191Jan 6, 2023Updated 3 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,308Updated this week
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆334Sep 29, 2023Updated 2 years ago
- Compass is a task diagnosis platform for bigdata☆405Nov 23, 2024Updated last year
- Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch …☆3,200Updated this week
- Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.☆1,114Feb 25, 2026Updated last week
- BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is w…☆1,679Jan 1, 2024Updated 2 years ago
- Elastic data processing with Apache Pulsar and Apache Flink☆283Nov 10, 2022Updated 3 years ago
- Mirror of Apache Bahir Flink☆784Oct 30, 2023Updated 2 years ago
- Benchmarks for Apache Flink☆185Jan 4, 2026Updated 2 months ago
- 汇总Apache Hudi相关资料☆558Jan 4, 2026Updated 2 months ago
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,715Updated this week
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆257Feb 21, 2023Updated 3 years ago
- Upserts, Deletes And Incremental Processing on Big Data.☆6,103Updated this week
- Apache Flink Kubernetes Operator☆989Updated this week
- Apache Kyuubi Site☆13Jan 5, 2026Updated last month
- Make stream processing easier! Easy-to-use streaming application development framework and operation platform.☆4,299Feb 24, 2026Updated last week
- Open source Java implementation for Raft consensus protocol.☆1,444Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,065Updated this week
- SparkSQL自定义Hint优化器解决热点数据导致JOIN数据倾斜问题☆48Jan 4, 2019Updated 7 years ago
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆889Feb 9, 2026Updated 3 weeks ago
- Apache Fluss is a streaming storage built for real-time analytics.☆1,801Updated this week
- Apache Iceberg☆8,572Updated this week
- World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.☆2,881Updated this week
- Apache flink☆50Feb 10, 2026Updated 3 weeks ago
- Shuttle：High Available, High Performance Remote Shuffle Service☆157Mar 28, 2023Updated 2 years ago
- Apache flink☆175Feb 23, 2026Updated last week
- The Lineage Analysis system for FlinkSQL supports advanced syntax such as Watermark, UDTF, CEP, Windowing TVFs, and CTAS.☆413Nov 20, 2025Updated 3 months ago
- Flink Connector for Apache Doris☆376Updated this week
- Testing Sandbox for Hadoop Ecosystem Components☆44Feb 25, 2026Updated last week
- Apache Calcite☆5,077Updated this week
- Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.☆3,696Dec 19, 2025Updated 2 months ago
- Playground for Flink Table Store with use cases and performance features☆51Apr 18, 2023Updated 2 years ago
- Flink CDC is a streaming data integration tool☆6,360Feb 25, 2026Updated last week
- Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications…☆3,416Feb 12, 2026Updated 2 weeks ago