coreweave / ml-containers

Related projects ⓘ

Alternatives and complementary repositories for ml-containers

• coreweave / nccl-tests
  NVIDIA NCCL Tests for Distributed Training
  ☆70Updated 2 weeks ago
• NVIDIA / k8s-nim-operator
  An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
  ☆58Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆189Updated last month
• elastic-ai / elastic-gpu-scheduler
  elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.
  ☆135Updated 2 years ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆42Updated 4 months ago
• NVIDIA / gpu-driver-container
  The NVIDIA GPU driver container allows the provisioning of the NVIDIA driver through the use of containers.
  ☆75Updated this week
• InftyAI / llmaz
  ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
  ☆30Updated last week
• leptonai / gpud
  ☆215Updated this week
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆205Updated 4 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆103Updated last week
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆59Updated 2 weeks ago
• run-ai / runai-model-streamer
  ☆123Updated this week
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆27Updated last year
• PaddleFlow / paddle-operator
  Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano
  ☆31Updated last year
• ray-project / kuberay-helm
  Helm charts for the KubeRay project
  ☆33Updated last month
• triton-inference-server / vllm_backend
  ☆193Updated this week
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated this week
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆54Updated 7 months ago
• project-codeflare / multi-cluster-app-dispatcher
  Holistic job manager on Kubernetes
  ☆108Updated 9 months ago
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆81Updated 9 months ago
• bentoml / llm-bench
  ☆36Updated this week
• kubernetes-sigs / lws
  LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
  ☆142Updated this week
• NVIDIA / cuda-checkpoint
  CUDA checkpoint and restore utility
  ☆227Updated 7 months ago
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆78Updated this week
• NVIDIA / mig-parted
  MIG Partition Editor for NVIDIA GPUs
  ☆174Updated this week
• onnx / neural-compressor
  Model compression for ONNX
  ☆75Updated last week
• imbue-ai / cluster-health
  ☆273Updated 3 months ago
• makllama / makllama
  MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.
  ☆28Updated 6 months ago
• NVIDIA / cloud-native-stack
  Run cloud native workloads on NVIDIA GPUs
  ☆135Updated last week
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆30Updated this week