SeldonIO / trtis-k8s-schedulerLinks
Custom Scheduler to deploy ML models to TRTIS for GPU Sharing
☆12Updated 5 years ago
Alternatives and similar repositories for trtis-k8s-scheduler
Users that are interested in trtis-k8s-scheduler are comparing it to the libraries listed below
Sorting:
- Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano☆32Updated 2 years ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆141Updated 2 years ago
- NVIDIA device plugin for Kubernetes☆15Updated 5 years ago
- More Flexible Device Extension Capability in Kubernetes (DevicePlugins++)☆23Updated last year
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆30Updated 5 months ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆125Updated 3 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆67Updated 3 weeks ago
- elastic-gpu-agent is a Kubernetes device plugin for GPU resources allocation on node.☆54Updated 2 years ago
- Elastic Serverless Serving based on Kubernetes, provides 0 instance serving capability.☆11Updated 3 years ago
- Fork of NVIDIA device plugin for Kubernetes with support for shared GPUs by declaring GPUs multiple times☆88Updated 2 years ago
- ☆42Updated last year
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policies☆113Updated this week
- IPAM plugin for kubernetes☆22Updated this week
- Device plugins for Volcano, e.g. GPU☆123Updated 2 months ago
- ☆62Updated last week
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆17Updated last week
- ☆31Updated 3 years ago
- Forked form☆11Updated 4 years ago
- Device-plugin for volcano vgpu which support hard resource isolation☆79Updated last week
- The API (CRD) of Volcano☆42Updated this week
- RDMA CNI plugin for containerized workloads☆52Updated 3 weeks ago
- ☆115Updated 2 years ago
- A Kubernetes operator for mxnet jobs☆53Updated 3 years ago
- Kernel for Kubeflow in Jupyter Notebook☆66Updated 5 years ago
- HTTP based Tree-shaped Peer2Peer blob transfer proxy, distributing images or blob data.☆22Updated 2 years ago
- Example DRA driver that developers can fork and modify to get them started writing their own.☆73Updated 2 weeks ago
- A simulator of Kuberntes for batch and service workload.☆46Updated 4 years ago
- Kubernetes Operator for AI and Bigdata Elastic Training☆85Updated 4 months ago
- RDMA device plugin for Kubernetes☆215Updated last year
- benchmark-for-spark☆16Updated 3 weeks ago