BaizeAI / kcoverLinks
🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
☆33Updated last week
Alternatives and similar repositories for kcover
Users that are interested in kcover are comparing it to the libraries listed below
Sorting:
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆69Updated 2 months ago
- A workload for deploying LLM inference services on Kubernetes☆70Updated last week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆257Updated 2 weeks ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆24Updated 9 months ago
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo…☆48Updated 2 weeks ago
- A federation scheduler for multi-cluster☆54Updated 3 months ago
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆17Updated 4 months ago
- A simulator of Kuberntes for batch and service workload.☆49Updated 4 years ago
- ☆121Updated 2 years ago
- Device plugins for Volcano, e.g. GPU☆128Updated 6 months ago
- d.run website☆15Updated this week
- Device-plugin for volcano vgpu which support hard resource isolation☆107Updated this week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- Large language model fine-tuning capabilities based on cloud native and distributed computing.☆93Updated last year
- The API (CRD) of Volcano☆45Updated last week
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 3 years ago
- [Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on tho…☆64Updated 3 years ago
- elastic-gpu-scheduler is a Kubernetes scheduler extender for GPU resources scheduling.☆145Updated 2 years ago
- A distributed engine for elastic workload, e.g. AI Agent, Quant☆29Updated this week
- Distributed KV cache coordinator☆71Updated last week
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.☆84Updated this week
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆54Updated 6 months ago
- The Volcano Descheduler☆18Updated 8 months ago
- ☆32Updated 4 years ago
- Using CRDs to manage GPU resources in Kubernetes.☆209Updated 2 years ago
- [Moved to https://github.com/kubernetes-sigs/kwok] fake-k8s is a tool for running Fake Kubernetes clusters, It can be used as an alternat…☆19Updated 2 years ago
- Inference scheduler for llm-d☆95Updated this week
- Go Abstraction for Allocating NVIDIA GPUs with Custom Policies☆115Updated 3 weeks ago
- Kubernetes Container Runtime Interface proxy service with hardware resource aware workload placement policies☆177Updated 2 months ago
- ☆146Updated 2 weeks ago