ashrafgt / k8s-gpu-hpa

Related projects ⓘ

Alternatives and complementary repositories for k8s-gpu-hpa

• kserve / modelmesh
  Distributed Model Serving Framework
  ☆154Updated 3 weeks ago
• mlflow / mlflow-torchserve
  Plugin for deploying MLflow models to TorchServe
  ☆105Updated last year
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆30Updated 2 years ago
• kserve / modelmesh-runtime-adapter
  Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods
  ☆21Updated last month
• coreweave / kubernetes-cloud
  Getting Started with the CoreWeave Kubernetes GPU Cloud
  ☆68Updated last week
• nebuly-ai / k8s-device-plugin
  NVIDIA device plugin for Kubernetes
  ☆46Updated 8 months ago
• run-ai / rntop
  A top-like tool for monitoring GPUs in a cluster
  ☆80Updated 8 months ago
• argoflow / argoflow
  Argoflow has been superseded by deployKF
  ☆137Updated last year
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆183Updated 2 months ago
• run-ai / docs
  markdown docs
  ☆68Updated this week
• kserve / modelmesh-serving
  Controller for ModelMesh
  ☆204Updated 3 months ago
• elastic-ai / elastic-gpu-scheduler
  elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.
  ☆135Updated last year
• elastic-ai / elastic-gpu-agent
  elastic-gpu-agent is a Kubernetes device plugin for GPU resources allocation on node.
  ☆54Updated 2 years ago
• kubernetes-sigs / jobset
  JobSet: a k8s native API for distributed ML training and HPC workloads
  ☆144Updated this week
• prabhuomkar / bitbeast
  Experiments with Model Training, Deployment & Monitoring
  ☆36Updated 8 months ago
• coreweave / ml-containers
  ☆24Updated this week
• NVIDIA / ais-k8s
  Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.
  ☆74Updated 2 weeks ago
• kserve / open-inference-protocol
  Repository for open inference protocol specification
  ☆42Updated 3 months ago
• NVIDIA / nvkind
  ☆51Updated this week
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆187Updated 3 weeks ago
• bentoml / simple_di
  Simple dependency injection framework for Python
  ☆20Updated 5 months ago
• Deepomatic / shared-gpu-nvidia-k8s-device-plugin
  Fork of NVIDIA device plugin for Kubernetes with support for shared GPUs by declaring GPUs multiple times
  ☆88Updated 2 years ago
• NVIDIA / gpu-feature-discovery
  GPU plugin to the node feature discovery for Kubernetes
  ☆291Updated 5 months ago
• awslabs / aws-virtual-gpu-device-plugin
  AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads
  ☆202Updated 11 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆123Updated this week
• kf5i / k3ai-core
  K3ai-core is the core library for the GO installer. Go installer will replace the current bash installer
  ☆23Updated 3 years ago
• tensorchord / envd-server
  Backend server for envd
  ☆21Updated 10 months ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆62Updated this week
• kserve / website
  User documentation for KServe.
  ☆105Updated this week
• sunhailin-Leo / triton-service-go
  Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
  ☆43Updated this week