💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
☆26Dec 6, 2024Updated last year
Alternatives and similar repositories for Manta
Users that are interested in Manta are comparing it to the libraries listed below
Sorting:
- Following the same workflows as Kubernetes. Widely used in InftyAI community.☆13Dec 5, 2025Updated 3 months ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆293Jan 26, 2026Updated last month
- WG Serving☆34Mar 5, 2026Updated 2 weeks ago
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆24Mar 3, 2026Updated 2 weeks ago
- Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…☆19Sep 16, 2022Updated 3 years ago
- 🎉 An awesome & curated list of best LLMOps tools.☆215Updated this week
- The Volcano Descheduler☆24Jan 24, 2025Updated last year
- Kubernetes 源码学习笔记 🔭☆23Apr 5, 2022Updated 3 years ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆677Mar 11, 2026Updated last week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆318Mar 13, 2026Updated last week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12May 16, 2023Updated 2 years ago
- CPU DRA Driver☆35Mar 12, 2026Updated last week
- data plane testing utility of cloud native☆222Feb 23, 2026Updated 3 weeks ago
- Simplified Data Management and Sharing for Kubernetes☆18Mar 11, 2026Updated last week
- Distributed KV cache scheduling & offloading libraries☆113Mar 13, 2026Updated last week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆35Updated this week
- GaussDB driver and toolkit for Go☆14Dec 17, 2025Updated 3 months ago
- [Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on tho…☆66Jul 20, 2022Updated 3 years ago
- Device-plugin for volcano vgpu which support hard resource isolation☆146Updated this week
- Gateway API Inference Extension☆609Updated this week
- 围绕云原生知识体系，收集一些不错的文章。仅供学习参考。☆53Jul 11, 2022Updated 3 years ago
- A workload for deploying LLM inference services on Kubernetes☆190Updated this week
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Sep 14, 2023Updated 2 years ago
- Prototypes and experiments for WG Device Management.☆15Mar 9, 2026Updated last week
- Federated middleware based on Karmada☆49Nov 20, 2023Updated 2 years ago
- d.run website☆16Mar 13, 2026Updated last week
- 实现对多个k8s集群的informer监听功能☆13Nov 25, 2023Updated 2 years ago
- Experimental DRA driver bringing CNI closer to Kubernetes☆39Oct 1, 2025Updated 5 months ago
- Package mount defines an interface to mounting filesystems.☆73Mar 10, 2026Updated last week
- The xline-operator is a powerful tool designed to automate the process of bootstrapping, monitoring, snapshotting, and recovering an xlin…☆16Feb 19, 2024Updated 2 years ago
- Operator for the mutating admission webhook for ClusterResourceOverride☆18Mar 13, 2026Updated last week
- Low level generic controller framework☆57Mar 12, 2026Updated last week
- A collection of useful Go libraries for use with NVIDIA GPU management tools☆50Jan 15, 2026Updated 2 months ago
- Go iSCSI initiator netlink library☆15Feb 25, 2023Updated 3 years ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆26Apr 24, 2025Updated 10 months ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆397Updated this week
- Inference scheduler for llm-d☆140Mar 12, 2026Updated last week
- Product ready cluster lifecycle management toolchains based on kubespray and other cluster LCM engine.☆525Updated this week
- Layer4 egress gateway for Kubernetes☆286Mar 13, 2026Updated last week