Alternatives and similar repositories for awesome-ray:

Users that are interested in awesome-ray are comparing it to the libraries listed below

• maxpumperla / learning_ray
  Notebooks for the O'Reilly book "Learning Ray"
  ☆269Updated 8 months ago
• AdrianBZG / LLM-distributed-finetune
  Tune efficiently any LLM model from HuggingFace using distributed training (multiple GPU) and DeepSpeed. Uses Ray AIR to orchestrate the …
  ☆53Updated last year
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆108Updated 2 months ago
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆76Updated last week
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• anyscale / llm-continuous-batching-benchmarks
  ☆114Updated 10 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆152Updated last month
• ray-project / enhancements
  Tracking Ray Enhancement Proposals
  ☆48Updated 2 weeks ago
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆54Updated 2 years ago
• pytorch / torchx
  TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…
  ☆336Updated last week
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆65Updated 4 months ago
• ucbrise / hypersched
  Deadline-based hyperparameter tuning on RayTune.
  ☆31Updated 5 years ago
• run-ai / llmperf
  ☆52Updated 4 months ago
• bentoml / llm-bench
  ☆41Updated 2 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆60Updated 9 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆107Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 5 months ago
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 7 months ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆166Updated last week
• ray-project / ray-educational-materials
  This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.
  ☆363Updated 11 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆64Updated this week
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆146Updated 6 months ago
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆66Updated last year
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆64Updated last month
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆43Updated 2 years ago
• triton-inference-server / vllm_backend
  ☆215Updated this week
• microsoft / DeepSpeed-Kernels
  ☆57Updated 7 months ago
• tyler-griggs / melange-release
  ☆43Updated 6 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆182Updated this week