aigw-project / aigwLinks
The Intelligent Inference Scheduler for Large-scale Inference Services.
☆48Updated this week
Alternatives and similar repositories for aigw
Users that are interested in aigw are comparing it to the libraries listed below
Sorting:
- Kubernetes-native AI serving platform for scalable model serving.☆125Updated this week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆73Updated 5 months ago
- A distributed system for Agentic AI☆35Updated this week
- A simulator of Kuberntes for batch and service workload.☆50Updated 4 years ago
- A workload for deploying LLM inference services on Kubernetes☆148Updated last week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆33Updated last week
- Paper Reading：涉及分布式、虚拟化、网络、机器学习☆23Updated 5 years ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆25Updated last year
- NVIDIA device plugin for Kubernetes☆15Updated 6 years ago
- Inference scheduler for llm-d☆111Updated this week
- Distributed KV cache coordinator☆92Updated last week
- llm-d helm charts and deployment examples☆48Updated 2 weeks ago
- ☆60Updated last month
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo…☆51Updated this week
- InfiniBand SR-IOV CNI☆14Updated 2 weeks ago
- ☆27Updated 2 years ago
- ☆21Updated last month
- GPU analyzer for Kubernetes GPU clusters☆17Updated 5 years ago
- ☆70Updated last week
- The Volcano Descheduler☆21Updated 11 months ago
- Resource Topology exporter for Topology Aware Scheduler☆15Updated 3 months ago
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆19Updated 7 months ago
- Device-plugin for volcano vgpu which support hard resource isolation☆138Updated this week
- ☆32Updated 4 years ago
- Batch-scheduler based on K8s scheduling framework, related features have contributed to scheduler-plugins(Deprecated).☆25Updated 5 years ago
- CubeFS Container Storage Interface (CSI) plugins.☆69Updated 4 months ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆351Updated this week
- 学习如何为 Kubernetes Operators 进行单元测试 Learning How to Write Unit Tests for Kubernetes Operators☆58Updated 6 years ago
- The API (CRD) of Volcano☆49Updated last week
- Kubernetes 源码学习笔记 🔭☆23Updated 3 years ago