volcano-sh / kthenaLinks
Kubernetes-native AI serving platform for scalable model serving.
☆154Updated this week
Alternatives and similar repositories for kthena
Users that are interested in kthena are comparing it to the libraries listed below
Sorting:
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆73Updated 5 months ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆283Updated 3 weeks ago
- A federation scheduler for multi-cluster☆59Updated 2 months ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆33Updated 3 weeks ago
- A workload for deploying LLM inference services on Kubernetes☆153Updated 2 weeks ago
- Device plugins for Volcano, e.g. GPU☆129Updated 9 months ago
- Device-plugin for volcano vgpu which support hard resource isolation☆138Updated last week
- The API (CRD) of Volcano☆49Updated last week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆25Updated last year
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo…☆51Updated this week
- Inference scheduler for llm-d☆113Updated this week
- ☆123Updated 3 years ago
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container☆262Updated last month
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆19Updated 7 months ago
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policies☆121Updated last month
- The Volcano Descheduler☆21Updated 11 months ago
- a unified scheduler for online and offline tasks☆639Updated 9 months ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆645Updated 2 weeks ago
- A simulator of Kuberntes for batch and service workload.☆50Updated 4 years ago
- Distributed KV cache scheduling & offloading libraries☆94Updated this week
- provide layer 3 and layer 7 network connectivity among pods in different physical regions☆61Updated 11 months ago
- Katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This is t…☆533Updated this week
- ☆328Updated last week
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆145Updated 3 years ago
- [Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on tho…☆66Updated 3 years ago
- Gateway API Inference Extension☆559Updated this week
- Yoda is a kubernetes scheduler based on GPU metrics. Yoda是一个基于GPU参数指标的 Kubernetes 调度器☆137Updated 3 years ago
- Example DRA driver that developers can fork and modify to get them started writing their own.☆111Updated 2 months ago
- Manage K8S like managing local files☆29Updated 2 years ago
- Using CRDs to manage GPU resources in Kubernetes.☆210Updated 3 years ago