BaizeAI / kcoverLinks
π§― Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
β34Updated 2 weeks ago
Alternatives and similar repositories for kcover
Users that are interested in kcover are comparing it to the libraries listed below
Sorting:
- Kubernetes-native AI serving platform for scalable model serving.β173Updated this week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.β74Updated 6 months ago
- A workload for deploying LLM inference services on Kubernetesβ167Updated this week
- π« A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIβ¦β25Updated last year
- A simulator of Kuberntes for batch and service workload.β50Updated 4 years ago
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repoβ¦β52Updated 2 weeks ago
- Device plugins for Volcano, e.g. GPUβ131Updated 10 months ago
- βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!β287Updated this week
- A federation scheduler for multi-clusterβ61Updated this week
- The Volcano Deschedulerβ21Updated last year
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policiesβ121Updated last month
- β122Updated 3 years ago
- β32Updated 4 years ago
- Device-plugin for volcano vgpu which support hard resource isolationβ142Updated last month
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.β19Updated 8 months ago
- [Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on thoβ¦β66Updated 3 years ago
- Large language model fine-tuning capabilities based on cloud native and distributed computing.β92Updated last year
- Inference scheduler for llm-dβ123Updated last week
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.β64Updated 3 weeks ago
- The API (CRD) of Volcanoβ49Updated this week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, iβ¦β12Updated 2 years ago
- d.run websiteβ15Updated last week
- The Intelligent Inference Scheduler for Large-scale Inference Services.β59Updated last month
- [Moved to https://github.com/kubernetes-sigs/kwok] fake-k8s is a tool for running Fake Kubernetes clusters, It can be used as an alternatβ¦β19Updated 3 years ago
- Distributed KV cache scheduling & offloading librariesβ98Updated this week
- Using CRDs to manage GPU resources in Kubernetes.β210Updated 3 years ago
- HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in containerβ269Updated last week
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.β145Updated 3 years ago
- HTTP based Tree-shaped Peer2Peer blob transfer proxy, distributing images or blob data.β25Updated 3 years ago
- β20Updated last week