Simplified model deployment on llm-d
☆28Jul 2, 2025Updated last year
Alternatives and similar repositories for llm-d-model-service
Users that are interested in llm-d-model-service are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llm-d benchmark scripts and tooling☆78Updated this week
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated 11 months ago
- helm charts for deploying models with llm-d☆32Updated this week
- Variant optimization autoscaler for distributed inference workloads☆62Oct 13, 2026Updated 3 weeks ago
- Distributed KV cache scheduling & offloading libraries☆191Oct 21, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Kubernetes CSI Driver for serving OCI model artifacts☆30May 25, 2026Updated 5 months ago
- Inference Platform Simulation☆54Updated this week
- No YAML deployments to K8s☆12Dec 31, 2025Updated 10 months ago
- ☆14May 11, 2026Updated 5 months ago
- A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual h…☆233Updated this week
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- llm-d Router: The intelligent entry point for inference requests☆456Updated this week
- Build and deploy Node.js application on Kubernetes☆16Sep 17, 2025Updated last year
- Automatically scales Kubernetes controllers to zero☆16May 30, 2019Updated 7 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- OCI registry pull performance benchmarking.☆14Sep 27, 2026Updated last month
- ☆22Sep 29, 2025Updated last year
- K8s Launch Kit (l8k) is a CLI tool for deploying and managing NVIDIA cloud-native solutions on Kubernetes. The tool helps provide flexibl…☆18Updated this week
- AI agent orchestration for open and closed source — a fully customizable fleet of AI agents covering every level of project maintenance, …☆80Updated this week
- State of the art inference performance with modern accelerators on Kubernetes☆5,158Updated this week
- Scripts and bits to help with ManageIQ daily dev work☆10Oct 29, 2019Updated 7 years ago
- ☆33Oct 28, 2026Updated last week
- Repository for the netperf component used by the Network-Aware framework for the Kubernetes platform based the Scheduler Framework☆10Dec 9, 2021Updated 4 years ago
- Augmented Dickey-Fuller implementation in Go☆12Mar 15, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- An SRIOV device plugin plugin☆15Aug 17, 2026Updated 2 months ago
- A LVM2 CSI plugin☆10Oct 25, 2023Updated 3 years ago
- 🔥 local cache for k8s apiserver 🔥☆13Dec 4, 2020Updated 5 years ago
- ☆212Jul 12, 2026Updated 3 months ago
- [DEPRECATED] Prometheus exporter for VPA recommendations☆12Aug 22, 2023Updated 3 years ago
- CLI for the Serverless Supercomputer☆25Sep 17, 2025Updated last year
- Installs and maintains the kube-scheduler on a cluster.☆37Updated this week
- RPG is tool, that guides people through the creation of a RPM package☆22Mar 16, 2016Updated 10 years ago
- ☆68Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tools to leverage Lmod in the ODH ecosystem☆14Jan 25, 2022Updated 4 years ago
- ☆12Dec 24, 2025Updated 10 months ago
- Deploy Sourcegraph to a Kubernetes (k8s) cluster with Kustomize for large-scale code search and intelligence☆17Oct 31, 2026Updated last week
- Go library for generating "git-compatible" patches☆14Feb 23, 2024Updated 2 years ago
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆84Oct 26, 2026Updated last week
- GenAI inference performance benchmarking tool☆271Updated this week
- 基于安卓 App 的 BOSS直聘纯算协议：离设备搜职位 + 短信登录的 CLI / MCP 工具（纯 Python 复现 native 请求加签 libyzwg）☆14Oct 19, 2026Updated 2 weeks ago