Alternatives and similar repositories for ml-containers:

Users that are interested in ml-containers are comparing it to the libraries listed below

• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆217Updated 3 weeks ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆89Updated last week
• run-ai / runai-model-streamer
  ☆169Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆120Updated 2 weeks ago
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆85Updated last year
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 2 months ago
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆23Updated this week
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆32Updated last month
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆82Updated this week
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆305Updated last month
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆33Updated this week
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆112Updated last year
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆31Updated this week
• ray-project / mlflow-ray-serve
  MLFlow Deployment Plugin for Ray Serve
  ☆44Updated 2 years ago
• run-ai / fake-gpu-operator
  ☆93Updated last month
• run-ai / llmperf
  ☆54Updated 5 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆69Updated last month
• determined-ai / determined-examples
  Example ML projects that use the Determined library.
  ☆29Updated 6 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆144Updated last week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆139Updated last week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆63Updated 11 months ago
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆87Updated this week
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆224Updated 2 weeks ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆48Updated 7 months ago
• bentoml / llm-bench
  ☆48Updated 3 months ago
• IBM / pytorch-communication-benchmarks
  pytorch code examples for measuring the performance of collective communication calls in AI workloads
  ☆15Updated 4 months ago
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆18Updated 2 years ago
• mlcommons / logging
  MLPerf™ logging library
  ☆33Updated this week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆189Updated this week