The Intelligent Inference Scheduler for Large-scale Inference Services.
☆64Feb 12, 2026Updated 3 weeks ago
Alternatives and similar repositories for aigw
Users that are interested in aigw are comparing it to the libraries listed below
Sorting:
- A Model Context Protocol (MCP) server implementation that enables comprehensive configuration and management of Higress.☆22Mar 29, 2025Updated 11 months ago
- An LLM Mock Server that supports simulating the protocols of all LLM providers.☆11Oct 18, 2025Updated 4 months ago
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆23Feb 25, 2026Updated last week
- Test Environment Booking tool☆14Nov 16, 2020Updated 5 years ago
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆26Apr 24, 2025Updated 10 months ago
- A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.☆87Updated this week
- Advanced block device testing/file system testing, targetting SNIA compatible reporting☆12Oct 15, 2025Updated 4 months ago
- Inference scheduler for llm-d☆135Updated this week
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆384Updated this week
- Python wrappers for the FirecREST API☆12Dec 23, 2025Updated 2 months ago
- llm-d helm charts and deployment examples☆50Feb 26, 2026Updated last week
- Lustre Repository with MS patches☆13Feb 28, 2026Updated last week
- extended benchmarking automation tool for HPC applications☆16Updated this week
- Cloyster HPC is a turnkey HPC cluster solution with an user-friendly installer☆10Oct 2, 2025Updated 5 months ago
- Koupleless serving system.☆11Oct 11, 2025Updated 4 months ago
- Auto detection of apt proxies in the LAN, caching and checking status☆10Feb 13, 2025Updated last year
- Lustre HSM tools☆10Feb 19, 2024Updated 2 years ago
- GUI for WireSock VPN client on Windows☆14Jul 8, 2024Updated last year
- A simple system with two microservices communicating via gRPC☆12May 18, 2018Updated 7 years ago
- Collection of my personal helper scripts.☆14Dec 23, 2025Updated 2 months ago
- Terraform resource provider to add/update/delete configuration items in a ServiceNow CMDB☆12Jan 12, 2023Updated 3 years ago
- Binary of pullcontainer☆10Dec 12, 2014Updated 11 years ago
- space-agent, as the carrier of AO.space all-in-one, mainly provides a unified entrance for AO.space server to start.☆10Feb 6, 2026Updated last month
- Kubernetes CSI Driver for serving OCI model artifacts☆24Updated this week
- A distributed, fast open-source graph database featuring horizontal scalability and high availability☆12May 6, 2025Updated 10 months ago
- RaptorJIT: a dynamic system programming language (manuscript)☆16Jun 4, 2019Updated 6 years ago
- Tool to profile usage of HPC resources by regularly probing processes.☆11Updated this week
- CLI tools for Slurm clusters☆13Dec 19, 2025Updated 2 months ago
- ☆10Nov 7, 2023Updated 2 years ago
- Slurm job script archival☆12Updated this week
- Collection of Singularity build files and scripts to create them for popular Linux Distributions☆10Jun 23, 2022Updated 3 years ago
- Small wrapper to enable running arbitrary docker run commands in nomad.☆10Oct 28, 2017Updated 8 years ago
- Fluentd output plugin to Yandex ClickHouse.☆11Nov 8, 2017Updated 8 years ago
- 基于Vue.js开发的新冠肺炎实时更新报告☆11May 9, 2022Updated 3 years ago
- Utilities to support interacting with multiple HPC clusters☆11Nov 21, 2025Updated 3 months ago
- Script for doing Slurm Calculations☆12Mar 21, 2025Updated 11 months ago
- Telegram bot which knows IPv6 excuses.☆11Mar 24, 2018Updated 7 years ago
- An advanced Git commit message generation utility designed to automatically craft high-quality commit messages with precision and sophist…☆16Feb 12, 2026Updated 3 weeks ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12May 16, 2023Updated 2 years ago