RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
☆381Nov 2, 2026Updated 2 weeks ago
Alternatives and similar repositories for raydp
Users that are interested in raydp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆105Jun 21, 2024Updated 2 years ago
- A toolkit to run Ray applications on Kubernetes☆2,775Updated this week
- Distributed SQL Query Engine in Python using Ray☆245Oct 2, 2024Updated 2 years ago
- NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs☆1,021Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,627Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆129Sep 23, 2025Updated last year
- Intel® End-to-End AI Optimization Kit☆30Jul 18, 2024Updated 2 years ago
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆255Feb 21, 2023Updated 3 years ago
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆44,340Updated this week
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 4 years ago
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,698Jun 12, 2026Updated 5 months ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…☆174Aug 8, 2026Updated 3 months ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,260Mar 13, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Integration between Lance and Ray for distributed data processing☆45Updated this week
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,855Nov 9, 2026Updated last week
- Tracking Ray Enhancement Proposals☆68Oct 1, 2026Updated last month
- Exoshuffle-CloudSort☆30Mar 2, 2023Updated 3 years ago
- Distributed XGBoost on Ray☆153Jun 25, 2024Updated 2 years ago
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,160Updated this week
- Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.☆1,850Updated this week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆7,371Updated this week
- Ray tutorials from Anyscale☆637Jun 25, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Ray-based Apache Beam runner☆42Aug 30, 2023Updated 3 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,895Jan 2, 2026Updated 10 months ago
- Pytorch Lightning Distributed Accelerators using Ray☆215Nov 3, 2023Updated 3 years ago
- MLFlow Deployment Plugin for Ray Serve☆47Apr 12, 2022Updated 4 years ago
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆455Updated this week
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,580Updated this week
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆50Nov 29, 2022Updated 3 years ago
- Byzer (former MLSQL): A low-code open-source programming language for data pipeline, analytics and AI.☆1,831May 29, 2024Updated 2 years ago
- Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.☆2,746Jan 2, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Lance Namespace is an open specification for describing access and operations against a collection of tables in a multimodal lakehouse☆59Oct 23, 2026Updated 3 weeks ago
- Examples on how to use LangChain and Ray☆231Jun 14, 2023Updated 3 years ago
- Deep Learning on Flink aims to integrate Flink and deep learning frameworks (e.g. TensorFlow, PyTorch, etc) to enable distributed deep le…☆695Nov 12, 2024Updated 2 years ago
- Apache DataFusion SQL Query Engine☆9,614Updated this week
- Training and serving large-scale neural networks with auto parallelization.☆3,176Dec 9, 2023Updated 2 years ago
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,379Updated this week
- A multiple parties joint, distributed execution engine based on Ray, to help build your own federated learning frameworks in minutes.☆97Aug 28, 2024Updated 2 years ago
Are these results useful?