Alternatives and similar repositories for aigw

Users that are interested in aigw are comparing it to the libraries listed below

• sgl-project / rbg
  A workload for deploying LLM inference services on Kubernetes
  ☆168Updated last week
• NVIDIA / knavigator
  knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.
  ☆74Updated 6 months ago
• houminz / paper-reading
  Paper Reading：涉及分布式、虚拟化、网络、机器学习
  ☆23Updated 5 years ago
• BaizeAI / kcover
  🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.
  ☆35Updated last week
• volcano-sh / volcano-global
  A federation scheduler for multi-cluster
  ☆61Updated 2 weeks ago
• kubewharf / godel-rescheduler
  ☆91Updated 9 months ago
• volcano-sh / descheduler
  The Volcano Descheduler
  ☆21Updated last year
• volcano-sh / kthena
  Kubernetes-native AI serving platform for scalable model serving.
  ☆208Updated this week
• xflops / flame
  A distributed system for Agentic AI
  ☆44Updated this week
• k82cn / kubesim
  A simulator of Kuberntes for batch and service workload.
  ☆50Updated 4 years ago
• InftyAI / Manta
  💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…
  ☆25Updated last year
• BoCloud / JobFlow
  vcjob Orchestruating Engine
  ☆30Updated 3 years ago
• sgl-project / ome
  Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…
  ☆365Updated last week
• volcano-sh / devices
  Device plugins for Volcano, e.g. GPU
  ☆132Updated 10 months ago
• kubewharf / katalyst-api
  katalyst aims to provide a universal solution to help improve resource utilization and optimize the overall costs in the cloud. This repo…
  ☆52Updated last week
• pokerfaceSad / GPUMounter
  A kubernetes plugin which enables dynamically add or remove GPU resources for a running Pod
  ☆127Updated 3 years ago
• llm-d / llm-d-kv-cache
  Distributed KV cache scheduling & offloading libraries
  ☆104Updated this week
• caicloud / learning-unit-testing-for-k8s-operator
  学习如何为 Kubernetes Operators 进行单元测试 Learning How to Write Unit Tests for Kubernetes Operators
  ☆58Updated 6 years ago
• volcano-sh / apis
  The API (CRD) of Volcano
  ☆49Updated last week
• kerthcet / kubernetes-design
  Kubernetes 源码学习笔记 🔭
  ☆23Updated 3 years ago
• tkestack / go-nvml
  ☆32Updated 4 years ago
• gpucloud / k8s-device-plugin
  NVIDIA device plugin for Kubernetes
  ☆15Updated 6 years ago
• Project-HAMi / HAMi-core
  HAMi-core compiles libvgpu.so, which ensures hard limit on GPU in container
  ☆275Updated 2 weeks ago
• cubefs / cubefs-csi
  CubeFS Container Storage Interface (CSI) plugins.
  ☆69Updated last month
• kuda-io / kuda
  Kubernetes 原生的数据交付平台
  ☆46Updated 3 years ago
• mosn / htnn
  HTNN: A cloud-native gateway offering seamless extensibility for Istio and Envoy, in a native way by Go.
  ☆123Updated last month
• Project-HAMi / volcano-vgpu-device-plugin
  Device-plugin for volcano vgpu which support hard resource isolation
  ☆143Updated last month
• elastic-ai / elastic-gpu
  Using CRDs to manage GPU resources in Kubernetes.
  ☆210Updated 3 years ago
• volcano-sh / resource-exporter
  Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.
  ☆19Updated 8 months ago
• KusionStack / resourceconsist
  Frame for controllers managing resource in/beyond Cluster, and offering the ability of following PodOpsLifecycle.
  ☆11Updated last week