Alternatives and similar repositories for ml-containers:

Users that are interested in ml-containers are comparing it to the libraries listed below

• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆217Updated last month
• run-ai / runai-model-streamer
  ☆170Updated last week
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆86Updated last year
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆23Updated this week
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆122Updated 3 weeks ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆84Updated last week
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• IBM / text-generation-inference
  IBM development fork of https://github.com/huggingface/text-generation-inference
  ☆60Updated 3 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆144Updated last week
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆49Updated 8 months ago
• SeldonIO / trtis-k8s-scheduler
  Custom Scheduler to deploy ML models to TRTIS for GPU Sharing
  ☆12Updated 4 years ago
• run-ai / llmperf
  ☆54Updated 6 months ago
• fmperf-project / fmperf
  Cloud Native Benchmarking of Foundation Models
  ☆24Updated 4 months ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆89Updated this week
• mlcommons / logging
  MLPerf™ logging library
  ☆33Updated last week
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆35Updated last month
• deepspeedai / DeepSpeed-Kernels
  ☆62Updated 3 weeks ago
• leptonai / gpud
  GPUd automates monitoring, diagnostics, and issue identification for GPUs
  ☆286Updated this week
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆140Updated last week
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆69Updated last month
• bentoml / llm-bench
  ☆48Updated 4 months ago
• project-codeflare / zero-copy-model-loading
  In-depth code associated with my Medium blog post, "How to Load PyTorch Models 340 Times Faster with Ray"
  ☆26Updated 2 years ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆86Updated 2 months ago
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆306Updated last month
• triton-inference-server / vllm_backend
  ☆237Updated last week
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆21Updated 3 weeks ago
• NVIDIA / gpu-driver-container
  The NVIDIA GPU driver container allows the provisioning of the NVIDIA driver through the use of containers.
  ☆99Updated this week
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆31Updated last week