RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
☆378Sep 11, 2026Updated last month
Alternatives and similar repositories for raydp
Users that are interested in raydp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A portable Multimodal Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to you…☆285Apr 17, 2026Updated 5 months ago
- Mobius is an AI infrastructure platform for distributed online learning, including online sample processing, training and serving.☆105Jun 21, 2024Updated 2 years ago
- A toolkit to run Ray applications on Kubernetes☆2,720Updated this week
- Distributed SQL Query Engine in Python using Ray☆245Oct 2, 2024Updated 2 years ago
- NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs☆1,008Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…☆18Jan 5, 2023Updated 3 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆17Aug 4, 2022Updated 4 years ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆129Sep 23, 2025Updated last year
- Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.☆255Feb 21, 2023Updated 3 years ago
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,602Updated this week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆44,004Updated this week
- BigDL: Distributed TensorFlow, Keras and PyTorch on Apache Spark/Flink & Ray☆2,698Jun 12, 2026Updated 3 months ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads. AntRay i…☆172Aug 8, 2026Updated 2 months ago
- A composable and fully extensible C++ execution engine library for data management systems.☆4,227Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,261Mar 13, 2025Updated last year
- Some microbenchmarks and design docs before commencement☆11Feb 1, 2021Updated 5 years ago
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,794Updated this week
- MLFlow Deployment Plugin for Ray Serve☆47Apr 12, 2022Updated 4 years ago
- Ray-based Apache Beam runner☆42Aug 30, 2023Updated 3 years ago
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,066Updated this week
- Tracking Ray Enhancement Proposals☆68Oct 1, 2026Updated last week
- Rayvens makes it possible for data scientists to access hundreds of data services within Ray with little effort.☆50Nov 29, 2022Updated 3 years ago
- Exoshuffle-CloudSort☆30Mar 2, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Distributed XGBoost on Ray☆153Jun 25, 2024Updated 2 years ago
- Mars is a tensor-based unified framework for large-scale data computation which scales numpy, pandas, scikit-learn and Python functions.☆2,744Jan 2, 2024Updated 2 years ago
- Spark* shuffle plugin for support shuffling data through a remote Hadoop-compatible file system, as opposed to vanilla Spark's local-dis…☆21Mar 15, 2024Updated 2 years ago
- Ray tutorials from Anyscale☆637Jun 25, 2026Updated 3 months ago
- Deep Learning on Flink aims to integrate Flink and deep learning frameworks (e.g. TensorFlow, PyTorch, etc) to enable distributed deep le…☆694Nov 12, 2024Updated last year
- Integration between Lance and Ray for distributed data processing☆43Sep 30, 2026Updated last week
- Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.☆1,812Updated this week
- Pytorch Lightning Distributed Accelerators using Ray☆215Nov 3, 2023Updated 2 years ago
- Examples on how to use LangChain and Ray☆231Jun 14, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- High performance model preprocessing library on PyTorch☆640Mar 29, 2024Updated 2 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,895Jan 2, 2026Updated 9 months ago
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆7,140Updated this week
- Cloud Scale Platform for Distributed Analytics and AI☆24Oct 12, 2023Updated 2 years ago
- A multiple parties joint, distributed execution engine based on Ray, to help build your own federated learning frameworks in minutes.☆97Aug 28, 2024Updated 2 years ago
- Optimized Spark package to accelerate machine learning algorithms in Apache Spark MLlib.☆22Jul 6, 2026Updated 3 months ago
- ☆30Aug 31, 2022Updated 4 years ago