ashrafgt / k8s-gpu-hpa
Horizontal Pod Autoscaling for Kubernetes using Nvidia GPU Metrics
☆32Updated 4 years ago
Alternatives and similar repositories for k8s-gpu-hpa
Users that are interested in k8s-gpu-hpa are comparing it to the libraries listed below
Sorting:
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆141Updated 2 years ago
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆355Updated this week
- GPU plugin to the node feature discovery for Kubernetes☆300Updated 11 months ago
- Collection of tools and examples for managing Accelerated workloads in Kubernetes Engine☆230Updated last week
- elastic-gpu-agent is a Kubernetes device plugin for GPU resources allocation on node.☆54Updated 2 years ago
- NVIDIA device plugin for Kubernetes☆48Updated last year
- JobSet: a k8s native API for distributed ML training and HPC workloads☆226Updated last week
- ☆31Updated last week
- Device plugins for Volcano, e.g. GPU☆119Updated last month
- Distributed Model Serving Framework☆165Updated this week
- Module, Model, and Tensor Serialization/Deserialization☆227Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆442Updated this week
- ☆207Updated last week
- AWS virtual gpu device plugin provides capability to use smaller virtual gpus for your machine learning inference workloads☆204Updated last year
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆96Updated this week
- Controller for ModelMesh☆230Updated this week
- Fork of NVIDIA device plugin for Kubernetes with support for shared GPUs by declaring GPUs multiple times☆88Updated 2 years ago
- The Triton backend for TensorFlow.☆51Updated last month
- ☆31Updated 2 years ago
- ☆150Updated last month
- ☆110Updated last week
- Getting Started with the CoreWeave Kubernetes GPU Cloud☆71Updated 2 months ago
- A top-like tool for monitoring GPUs in a cluster☆86Updated last year
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆200Updated 3 weeks ago
- Practical GPU Sharing Without Memory Size Constraints☆264Updated last month
- Common source, scripts and utilities shared across all Triton repositories.☆71Updated 2 weeks ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆167Updated this week
- ☆115Updated 2 years ago
- Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elas…☆658Updated last year
- Share GPU between Pods in Kubernetes☆209Updated 2 years ago