aigw-project / aigwLinks
The Intelligent Inference Scheduler for Large-scale Inference Services.
☆55Updated 3 weeks ago
Alternatives and similar repositories for aigw
Users that are interested in aigw are comparing it to the libraries listed below
Sorting:
- A distributed system for Agentic AI☆42Updated this week
- Paper Reading:涉及分布式、虚拟化、网络、机器学习☆23Updated 5 years ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆25Updated last year
- A workload for deploying LLM inference services on Kubernetes☆156Updated last week
- A simulator of Kuberntes for batch and service workload.☆50Updated 4 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆74Updated 6 months ago
- Kubernetes-native AI serving platform for scalable model serving.☆168Updated this week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆34Updated this week
- The Volcano Descheduler☆21Updated 11 months ago
- Kubernetes 源码学习笔记 🔭☆23Updated 3 years ago
- 学习如何为 Kubernetes Operators 进行单元测试 Learning How to Write Unit Tests for Kubernetes Operators☆58Updated 6 years ago
- Distributed KV cache scheduling & offloading libraries☆98Updated this week
- ☆27Updated 2 years ago
- NVIDIA device plugin for Kubernetes☆15Updated 6 years ago
- A Kubernetes-Native Application based on eBPF.☆22Updated 6 months ago
- ☆70Updated last week
- ☆60Updated last month
- Inference scheduler for llm-d☆120Updated this week
- katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo…☆51Updated last week
- Resource Topology exporter for Topology Aware Scheduler☆15Updated 3 months ago
- CubeFS Container Storage Interface (CSI) plugins.☆69Updated last week
- Simplify Kubernetes applications operation with one-stop observability services, including resource delivery SLO,root cause diagnoses and…☆107Updated last year
- The API (CRD) of Volcano☆49Updated last week
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆19Updated 7 months ago
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆34Updated 2 years ago
- ☆32Updated 4 years ago
- InfiniBand SR-IOV CNI☆13Updated last month
- ☆91Updated 9 months ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆356Updated this week
- Backend server for envd☆22Updated 2 years ago