Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
☆262May 12, 2024Updated last year
Alternatives and similar repositories for CloudShuffleService
Users that are interested in CloudShuffleService are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,042Updated this week
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆448Apr 7, 2026Updated last week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,547Updated this week
- Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…☆257Apr 7, 2023Updated 3 years ago
- Remote Shuffle Service for Flink☆191Jan 6, 2023Updated 3 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,322Updated this week
- Compass is a task diagnosis platform for bigdata☆405Nov 23, 2024Updated last year
- Remote shuffle service for Apache Spark to store shuffle data on remote servers.☆335Sep 29, 2023Updated 2 years ago
- Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch …☆3,236Updated this week
- BitSail is a distributed high-performance data integration engine which supports batch, streaming and incremental scenarios. BitSail is w…☆1,682Jan 1, 2024Updated 2 years ago
- Apache Amoro(incubating) is a Lakehouse management system built on open data lake formats.☆1,122Updated this week
- Elastic data processing with Apache Pulsar and Apache Flink☆282Nov 10, 2022Updated 3 years ago
- Mirror of Apache Bahir Flink☆781Oct 30, 2023Updated 2 years ago
- 汇总Apache Hudi相关资料☆558Mar 31, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,743Apr 8, 2026Updated last week
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆257Feb 21, 2023Updated 3 years ago
- A composable and fully extensible C++ execution engine library for data management systems.☆4,090Apr 8, 2026Updated last week
- Benchmarks for Apache Flink☆185Jan 4, 2026Updated 3 months ago
- Apache Kyuubi Site☆12Mar 26, 2026Updated 2 weeks ago
- Upserts, Deletes And Incremental Processing on Big Data.☆6,139Updated this week
- Open source Java implementation for Raft consensus protocol.☆1,444Updated this week
- Apache Flink Kubernetes Operator☆1,000Updated this week
- Make stream processing easier! Easy-to-use streaming application development framework and operation platform.☆4,305Mar 26, 2026Updated 2 weeks ago
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Apache Iceberg☆8,700Apr 7, 2026Updated last week
- Coral is a translation, analysis, and query rewrite engine for SQL and other relational languages.☆897Updated this week
- Apache flink☆51Updated this week
- Apache flink☆182Mar 27, 2026Updated 2 weeks ago
- SparkSQL自定义Hint优化器解决热点数据导致JOIN数据倾斜问题☆48Jan 4, 2019Updated 7 years ago
- World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.☆2,913Updated this week
- ☆17Mar 19, 2024Updated 2 years ago
- Apache Fluss is a streaming storage built for real-time analytics.☆1,855Updated this week
- Apache Calcite☆5,105Updated this week
- Deploy open-source AI quickly and easily - Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Shuttle：High Available, High Performance Remote Shuffle Service☆158Mar 28, 2023Updated 3 years ago
- A tool to get better debug info on spark's memory usage☆42Aug 21, 2019Updated 6 years ago
- Testing Sandbox for Hadoop Ecosystem Components☆44Apr 2, 2026Updated last week
- Flink Connector for Apache Doris☆376Apr 7, 2026Updated last week
- Playground for Flink Table Store with use cases and performance features☆51Apr 18, 2023Updated 2 years ago
- FlinkSQL数据脱敏和行级权限解决方案及源码，支持面向用户级别的数据脱敏和行级数据访问控制，即特定用户只能访问到脱敏后的数据或授权过的行。此方案是实时领域Flink的解决方案，类似于离线数仓Hive Ranger中的Row-level Filter和Column Mas…☆147Oct 12, 2023Updated 2 years ago
- Dinky is a real-time data development platform based on Apache Flink, enabling agile data development, deployment and operation.☆3,718Mar 21, 2026Updated 3 weeks ago