aigw-project / aigwLinks
The Intelligent Inference Scheduler for Large-scale Inference Services.
☆61Updated last week
Alternatives and similar repositories for aigw
Users that are interested in aigw are comparing it to the libraries listed below
Sorting:
- A distributed system for Agentic AI☆44Updated this week
- Paper Reading：涉及分布式、虚拟化、网络、机器学习☆23Updated 5 years ago
- A workload for deploying LLM inference services on Kubernetes☆168Updated last week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆25Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆74Updated 6 months ago
- Kubernetes-native AI serving platform for scalable model serving.☆208Updated this week
- Kubernetes 源码学习笔记 🔭☆23Updated 3 years ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆35Updated last week
- A simulator of Kuberntes for batch and service workload.☆50Updated 4 years ago
- Simplify Kubernetes applications operation with one-stop observability services, including resource delivery SLO，root cause diagnoses and…☆108Updated last year
- ☆91Updated 9 months ago
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo…☆52Updated last week
- The Volcano Descheduler☆21Updated last year
- vcjob Orchestruating Engine☆30Updated 3 years ago
- CubeFS Container Storage Interface (CSI) plugins.☆69Updated last month
- 学习如何为 Kubernetes Operators 进行单元测试 Learning How to Write Unit Tests for Kubernetes Operators☆58Updated 6 years ago
- NVIDIA device plugin for Kubernetes☆15Updated 6 years ago
- ☆27Updated 2 years ago
- ☆71Updated last week
- The API (CRD) of Volcano☆49Updated last week
- HTNN: A cloud-native gateway offering seamless extensibility for Istio and Envoy, in a native way by Go.☆123Updated last month
- Device plugins for Volcano, e.g. GPU☆132Updated 10 months ago
- A federation scheduler for multi-cluster☆61Updated 2 weeks ago
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆34Updated 2 years ago
- A template for starting new golang projects at Caicloud☆57Updated 3 years ago
- A Kubernetes-Native Application based on eBPF.☆22Updated 7 months ago
- Kubernetes 原生的数据交付平台☆46Updated 3 years ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆365Updated last week
- ☆32Updated 4 years ago
- A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod☆127Updated 3 years ago