Alternatives and similar repositories for submarine:

Users that are interested in submarine are comparing it to the libraries listed below

• apache / celeborn
  Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
  ☆926Updated this week
• apache / ozone
  Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.
  ☆881Updated this week
• apache / yunikorn-core
  Apache YuniKorn Core
  ☆889Updated this week
• flink-extended / dl-on-flink
  Deep Learning on Flink aims to integrate Flink and deep learning frameworks (e.g. TensorFlow, PyTorch, etc) to enable distributed deep le…
  ☆689Updated 3 months ago
• apache / amoro
  Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
  ☆921Updated this week
• Tencent / Firestorm
  Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…
  ☆255Updated last year
• apache / incubator-uniffle
  Uniffle is a high performance, general purpose Remote Shuffle Service.
  ☆400Updated this week
• apache / flink-ml
  Machine learning library of Apache Flink
  ☆314Updated 3 months ago
• apache / kyuubi
  Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
  ☆2,143Updated this week
• apache / gravitino
  World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
  ☆1,240Updated this week
• alibaba / feathub
  FeatHub - A stream-batch unified feature store for real-time machine learning
  ☆320Updated 8 months ago
• apache / incubator-gluten
  Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
  ☆1,268Updated this week
• apache / incubator-livy
  Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
  ☆901Updated 3 months ago
• tony-framework / TonY
  TonY is a framework to natively run deep learning frameworks on Apache Hadoop.
  ☆709Updated last year
• apache / tez
  Apache Tez
  ☆489Updated last month
• apache / yunikorn-k8shim
  Apache YuniKorn K8shim
  ☆147Updated last week
• linkedin / transport
  A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…
  ☆299Updated last year
• hortonworks / hive-testbench
  ☆381Updated last year
• bytedance / CloudShuffleService
  Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
  ☆255Updated 9 months ago
• flink-extended / flink-remote-shuffle
  Remote Shuffle Service for Flink
  ☆189Updated 2 years ago
• leesf / hudi-resources
  汇总Apache Hudi相关资料
  ☆544Updated last month
• ververica / flink-sql-gateway
  ☆488Updated 2 years ago
• openlookeng / hetu-core
  ☆568Updated last year
• hortonworks-spark / spark-atlas-connector
  A Spark Atlas connector to track data lineage in Apache Atlas
  ☆266Updated 2 years ago
• oap-project / raydp
  RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
  ☆325Updated this week
• oap-project / gazelle_plugin
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆257Updated 2 years ago
• byzer-org / byzer-lang
  Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.
  ☆1,836Updated 8 months ago
• NVIDIA / spark-rapids
  Spark RAPIDS plugin - accelerate Apache Spark with GPUs
  ☆857Updated this week
• apache / ranger
  Apache Ranger - To enable, monitor and manage comprehensive data security across the Hadoop platform and beyond
  ☆928Updated this week
• harbby / sylph
  Stream computing platform for bigdata
  ☆401Updated 9 months ago