Alternatives and similar repositories for ml-containers:

Users that are interested in ml-containers are comparing it to the libraries listed below

• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆225Updated 2 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆126Updated this week
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆86Updated last year
• run-ai / runai-model-streamer
  ☆205Updated last month
• bentoml / llm-bench
  ☆50Updated 5 months ago
• ray-project / pygloo
  Pygloo provides Python bindings for Gloo.
  ☆22Updated 2 months ago
• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆88Updated last week
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆29Updated 2 weeks ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆70Updated 2 months ago
• run-ai / llmperf
  ☆53Updated 7 months ago
• imbue-ai / cluster-health
  ☆304Updated 8 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆148Updated this week
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆94Updated this week
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆26Updated this week
• triton-inference-server / tensorflow_backend
  The Triton backend for TensorFlow.
  ☆51Updated 3 weeks ago
• ray-project / distml
  Distributed ML Optimizer
  ☆32Updated 3 years ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆38Updated 3 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆68Updated last month
• determined-ai / determined-examples
  Example ML projects that use the Determined library.
  ☆32Updated 7 months ago
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆33Updated last month
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆31Updated 2 weeks ago
• NVIDIA / gpu-driver-container
  The NVIDIA GPU driver container allows the provisioning of the NVIDIA driver through the use of containers.
  ☆110Updated this week
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆68Updated last week
• foundation-model-stack / fastsafetensors
  High-performance safetensors model loader
  ☆25Updated 3 weeks ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated last year
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆330Updated 3 months ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆54Updated 9 months ago
• facebookresearch / PostText
  PostText is a QA system for querying your text data. When appropriate structured views are in place, PostText is good at answering querie…
  ☆32Updated last year
• IBM / pytorch-communication-benchmarks
  pytorch code examples for measuring the performance of collective communication calls in AI workloads
  ☆16Updated 6 months ago
• foundation-model-stack / fms-acceleration
  🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
  ☆9Updated this week