The Intelligent Inference Scheduler for Large-scale Inference Services.
☆72Feb 12, 2026Updated 8 months ago
Alternatives and similar repositories for aigw
Users that are interested in aigw are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆27Apr 24, 2025Updated last year
- DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.☆103Jan 16, 2026Updated 9 months ago
- PegaFlow is a high-performance KV cache offloading solution for vLLM v1 on single-node multi-GPU setups.☆25Jan 7, 2026Updated 9 months ago
- HTNN: A cloud-native gateway offering seamless extensibility for Istio and Envoy, in a native way by Go.☆124Oct 20, 2026Updated last week
- handle gguf files☆15Aug 14, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A workload for deploying LLM inference services on Kubernetes☆312Updated this week
- LMCache-Ascend is a plugin for running LMCache on the Ascend NPU.☆92Updated this week
- consistent hash for openresty☆28Jan 15, 2019Updated 7 years ago
- Lightweight, Modular, Kubernetes-native AI serving platform for scalable model serving.☆488Updated this week
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆30Oct 21, 2026Updated last week
- A go sdk for coding Higress wasm plugins.☆35Sep 6, 2026Updated last month
- An LLM Mock Server that supports simulating the protocols of all LLM providers.☆16Jul 10, 2026Updated 3 months ago
- A high-performance and light-weight router for vLLM large scale deployment☆483Updated this week
- High Performance KV Cache Store for LLM☆59May 20, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- What if everything is a io_uring?☆17Nov 10, 2022Updated 3 years ago
- ☆380Updated this week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆35Oct 22, 2026Updated last week
- ☆176Updated this week
- KV cache store for distributed LLM inference☆449Sep 16, 2026Updated last month
- A better wrapper for using RDMA programming APIs in Rust flavor☆95Oct 15, 2026Updated 2 weeks ago
- a fork from golang/debug☆16Aug 16, 2022Updated 4 years ago
- ☆12May 22, 2023Updated 3 years ago
- Healthcheck library for OpenResty to validate upstream service status☆14Jul 21, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆13May 16, 2023Updated 3 years ago
- ☆11Jul 6, 2023Updated 3 years ago
- Offline optimization of your disaggregated Dynamo graph☆462Oct 20, 2026Updated last week
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆1,013Oct 22, 2026Updated last week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆6,887Updated this week
- ☆11Nov 11, 2025Updated 11 months ago
- 我陈平安，唯有一键，可搬山，倒海，降妖，镇魔，敕神，摘星，断江，摧城，开天！☆22Jun 4, 2022Updated 4 years ago
- An example of using hashicorp/raft☆18Dec 1, 2015Updated 10 years ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆521Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- WebAssembly for Proxies (Go SDK)☆20May 25, 2026Updated 5 months ago
- Cumora desktop release archive — DMGs, ZIPs, installers, auto-update feeds. Source code lives at yetone/cumora.☆17Updated this week
- Kubernetes CSI Driver for serving OCI model artifacts☆30May 25, 2026Updated 5 months ago
- Lua binding for the lol-HTML rewriter/parser☆19Nov 14, 2020Updated 5 years ago
- ☆36Jan 13, 2021Updated 5 years ago
- An OS kernel module for fast **remote** fork using advanced datacenter networking (RDMA).☆73Feb 15, 2025Updated last year
- RocksDB/LevelDB inspired key-value database in Go☆10Nov 3, 2020Updated 5 years ago