JiahaoYao / awesome-ray
Ray - A curated list of resources: https://github.com/ray-project/ray
☆50Updated 2 weeks ago
Alternatives and similar repositories for awesome-ray:
Users that are interested in awesome-ray are comparing it to the libraries listed below
- Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …☆55Updated last year
- Notebooks for the O'Reilly book "Learning Ray"☆276Updated 9 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆110Updated this week
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆154Updated 2 months ago
- FIL backend for the Triton Inference Server☆76Updated this week
- Ray-based Apache Beam runner☆43Updated last year
- Serverless Python with Ray☆54Updated 2 years ago
- ☆117Updated 10 months ago
- Distributed ML Optimizer☆30Updated 3 years ago
- WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.☆18Updated 2 years ago
- Distributed XGBoost on Ray☆147Updated 7 months ago
- This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.☆373Updated last year
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆345Updated this week
- Torch Distributed Experimental☆115Updated 6 months ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆187Updated this week
- Introduction to Ray Core Design Patterns and APIs.☆66Updated last year
- ☆27Updated last year
- experiments with inference on llama☆104Updated 8 months ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆61Updated 10 months ago
- The Triton backend for the PyTorch TorchScript models.☆143Updated this week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆196Updated last month
- Home for OctoML PyTorch Profiler☆107Updated last year
- ☆223Updated this week
- LLM Serving Performance Evaluation Harness☆66Updated 5 months ago
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆53Updated this week
- A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…☆66Updated last year
- Applied AI experiments and examples for PyTorch☆223Updated this week
- End-to-End LLM Guide☆101Updated 7 months ago
- Simple Distributed Deep Learning on TensorFlow☆134Updated 2 years ago
- Unified storage framework for the entire machine learning lifecycle☆155Updated 11 months ago