oap-project / raydp

Related projects ⓘ

Alternatives and complementary repositories for raydp

• NVIDIA / spark-rapids
  Spark RAPIDS plugin - accelerate Apache Spark with GPUs
  ☆822Updated this week
• ray-project / deltacat
  A portable Pythonic Data Catalog API powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture t…
  ☆165Updated 2 weeks ago
• alibaba / feathub
  FeatHub - A stream-batch unified feature store for real-time machine learning
  ☆315Updated 5 months ago
• NVIDIA / spark-rapids-examples
  A repo for all spark examples using Rapids Accelerator including ETL, ML/DL, etc.
  ☆127Updated this week
• oap-project / gazelle_plugin
  Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
  ☆256Updated last year
• ray-project / mobius
  Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.
  ☆90Updated 5 months ago
• ray-project / enhancements
  Tracking Ray Enhancement Proposals
  ☆49Updated last week
• datafusion-contrib / ray-sql
  Distributed SQL Query Engine in Python using Ray
  ☆239Updated last month
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆144Updated 4 months ago
• Ackuq / spark-pit
  Point-in-Time optimizations for Apache Spark
  ☆29Updated 10 months ago
• apache / spark-kubernetes-operator
  Apache Spark Kubernetes Operator
  ☆65Updated last week
• ray-project / ray_beam_runner
  Ray-based Apache Beam runner
  ☆42Updated last year
• uber / RemoteShuffleService
  Remote shuffle service for Apache Spark to store shuffle data on remote servers.
  ☆323Updated last year
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆342Updated 5 months ago
• Tencent / Firestorm
  Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shu…
  ☆252Updated last year
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆142Updated 8 months ago
• apache / incubator-gluten
  Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
  ☆1,212Updated this week
• apache / incubator-uniffle
  Uniffle is a high performance, general purpose Remote Shuffle Service.
  ☆384Updated this week
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆111Updated this week
• MemVerge / splash
  Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
  ☆127Updated last month
• hopshadoop / hops
  Hops Hadoop is a distribution of Apache Hadoop with distributed metadata.
  ☆309Updated 3 weeks ago
• aws-samples / eks-spark-benchmark
  Performance optimization for Spark running on Kubernetes
  ☆85Updated 4 years ago
• bennfocus / feast-hive
  Hive support for Feast offline store
  ☆32Updated 2 years ago
• cerndb / SparkPlugins
  Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are in…
  ☆85Updated 7 months ago
• maropu / spark-tpcds-datagen
  All the things about TPC-DS in Apache Spark
  ☆104Updated last year
• oap-project / Gluten-Trino
  Gluten: Plugin to Boost Trino's Performance
  ☆70Updated last year
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated last year