SeldonIO / trtis-k8s-schedulerLinks
Custom Scheduler to deploy ML models to TRTIS for GPU Sharing
☆11Updated 5 years ago
Alternatives and similar repositories for trtis-k8s-scheduler
Users that are interested in trtis-k8s-scheduler are comparing it to the libraries listed below
Sorting:
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆145Updated 3 years ago
- elastic-gpu-agent is a Kubernetes device plugin for GPU resources allocation on node.☆55Updated 3 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆74Updated 6 months ago
- Holistic job manager on Kubernetes☆116Updated last year
- More Flexible Device Extension Capability in Kubernetes (DevicePlugins++)☆25Updated 2 years ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆127Updated 3 years ago
- NVIDIA device plugin for Kubernetes☆15Updated 6 years ago
- Device plugins for Volcano, e.g. GPU☆131Updated 10 months ago
- Fork of NVIDIA device plugin for Kubernetes with support for shared GPUs by declaring GPUs multiple times☆87Updated 3 years ago
- ☆71Updated last week
- GPU plugin to the node feature discovery for Kubernetes☆308Updated last year
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆204Updated 3 years ago
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policies☆121Updated last month
- ☆32Updated 4 years ago
- GPU analyzer for Kubernetes GPU clusters☆17Updated 5 years ago
- Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano☆32Updated 2 years ago
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆124Updated this week
- WG Serving☆34Updated last month
- A simulator of Kuberntes for batch and service workload.☆50Updated 4 years ago
- Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)☆510Updated 2 weeks ago
- GenAI inference performance benchmarking tool☆141Updated last week
- Cloud Native Machine Learning Model Registry☆82Updated 3 years ago
- kubernetes device plugin for using /dev/fuse without privilege☆66Updated 3 years ago
- Automatic tuning for ML model deployment on Kubernetes☆81Updated last year
- The scheduler of Volcano, built based on kubernetes-sigs/kube-batch☆14Updated 6 years ago
- Golang bindings for Nvidia Datacenter GPU Manager (DCGM)☆147Updated 2 weeks ago
- Backend server for envd☆22Updated 2 years ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆35Updated this week
- A Kubernetes operator for mxnet jobs☆52Updated 4 years ago
- very thin kubernetes device plugin which just exposes device files in host to containers.☆51Updated 3 weeks ago