SeldonIO / trtis-k8s-scheduler
Custom Scheduler to deploy ML models to TRTIS for GPU Sharing
☆12Updated 4 years ago
Alternatives and similar repositories for trtis-k8s-scheduler:
Users that are interested in trtis-k8s-scheduler are comparing it to the libraries listed below
- Elastic Serverless Serving based on Kubernetes, provides 0 instance serving capability.☆10Updated 3 years ago
- elastic-gpu-agent is a Kubernetes device plugin for GPU resources allocation on node.☆54Updated 2 years ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆140Updated 2 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆62Updated last month
- Elastic Deep Learning Training based on Kubernetes by Leveraging EDL and Volcano☆32Updated last year
- NVIDIA device plugin for Kubernetes☆15Updated 5 years ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆123Updated 3 years ago
- More Flexible Device Extension Capability in Kubernetes (DevicePlugins++)☆23Updated last year
- Device plugins for Volcano, e.g. GPU☆115Updated 5 months ago
- ☆60Updated 2 weeks ago
- ☆113Updated 2 years ago
- Holistic job manager on Kubernetes☆112Updated last year
- Fork of NVIDIA device plugin for Kubernetes with support for shared GPUs by declaring GPUs multiple times☆88Updated 2 years ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆26Updated 2 months ago
- Device-plugin for volcano vgpu which support hard resource isolation☆64Updated this week
- Backend server for envd☆20Updated last year
- A simulator of Kuberntes for batch and service workload.☆45Updated 3 years ago
- Cloud-native way to provide elastic Jupyter Notebooks on Kubernetes. Run remote kernels, natively.☆195Updated 2 years ago
- Intelligent platform for AI workloads☆37Updated 2 years ago
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆15Updated 4 months ago
- ☆131Updated 3 years ago
- Incubating: A framework for writing Kubernetes Device Plugins☆32Updated last month
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆87Updated this week
- ☆235Updated this week
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policies☆113Updated 7 months ago
- ☆31Updated 3 years ago
- The API (CRD) of Volcano☆37Updated this week
- Kubernetes Operator for AI and Bigdata Elastic Training☆85Updated 2 months ago
- InfiniBand SR-IOV CNI☆46Updated last month
- RDMA CNI plugin for containerized workloads☆49Updated last month