Alternatives and similar repositories for ray-docker-compose

Users that are interested in ray-docker-compose are comparing it to the libraries listed below

• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆21Updated last year
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆46Updated 3 years ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated 2 years ago
• ray-project / xgboost_ray
  Distributed XGBoost on Ray
  ☆152Updated last year
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆110Updated 2 years ago
• triton-inference-server / fil_backend
  FIL backend for the Triton Inference Server
  ☆87Updated this week
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆173Updated this week
• clearml / clearml-serving
  ClearML - Model-Serving Orchestration and Repository Solution
  ☆161Updated last month
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆217Updated this week
• treeverse / dataset-registry
  Dataset registry DVC project
  ☆85Updated last year
• RedisAI / redisai-py
  Python client for RedisAI
  ☆89Updated 2 years ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 5 years ago
• anyscale / airflow-provider-ray
  Ray provider for Apache Airflow
  ☆47Updated 2 years ago
• triton-inference-server / stateful_backend
  Triton backend for managing the model state tensors automatically in sequence batcher
  ☆17Updated last year
• project-codeflare / zero-copy-model-loading
  In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"
  ☆28Updated 3 years ago
• SeldonIO / tempo
  MLOps Python Library
  ☆121Updated 3 years ago
• zilliztech / awesome-milvus
  A curated list of awesome Milvus projects and resources.
  ☆34Updated 2 years ago
• okanlv / fsdl-full-stack-stable-diffusion-2022
  ☆17Updated 3 years ago
• bentoml / gallery
  BentoML Example Projects 🎨
  ☆142Updated last year
• bentoml / llm-bench
  ☆56Updated last year
• scalingpythonml / scaling-python-with-ray
  Serverless Python with Ray
  ☆59Updated 3 years ago
• fidelity / stoke
  A lightweight wrapper for PyTorch that provides a simple declarative API for context switching between devices, distributed modes, mixed-…
  ☆66Updated 2 years ago
• intel / e2eAIOK
  Intel® End-to-End AI Optimization Kit
  ☆31Updated last year
• nicolargo / nvidia-ml-py3
  Python 3 Bindings for the NVIDIA Management Library
  ☆142Updated last year
• microsoft / batch-inference
  Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.
  ☆106Updated last year
• ray-project / distml
  Distributed ML Optimizer
  ☆35Updated 4 years ago
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆30Updated 3 years ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆130Updated 4 months ago
• scalingpythonml / scalingpythonml
  Scaling Python Machine Learning
  ☆53Updated 2 years ago
• cortexlabs / nucleus
  Cortex-compatible model server for Python and TensorFlow
  ☆18Updated 3 years ago