Simplified model deployment on llm-d
☆28Jul 2, 2025Updated last year
Alternatives and similar repositories for llm-d-model-service
Users that are interested in llm-d-model-service are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llm-d benchmark scripts and tooling☆73Updated this week
- helm charts for deploying models with llm-d☆32Oct 10, 2026Updated last week
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated 11 months ago
- Inference Platform Simulation☆42Updated this week
- Variant optimization autoscaler for distributed inference workloads☆60Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Kubernetes CSI Driver for serving OCI model artifacts☆30May 25, 2026Updated 4 months ago
- label ALL kubectl, kustomize, and helm objects, inline, without extra steps.(including namespaces and CRDs)☆15Apr 22, 2024Updated 2 years ago
- Distributed KV cache scheduling & offloading libraries☆186Updated this week
- llm-d Router: The intelligent entry point for inference requests☆418Updated this week
- A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual h…☆215Updated this week
- Build and deploy Node.js application on Kubernetes☆16Sep 17, 2025Updated last year
- Kubernetes release optimizer☆269Aug 1, 2024Updated 2 years ago
- ☆10Apr 30, 2020Updated 6 years ago
- Achieve state of the art inference performance with modern accelerators on Kubernetes☆4,854Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Golang library for analyzing k8s connectivity-configuration resources (a.k.a. network policies)☆21Feb 1, 2026Updated 8 months ago
- [DEPRECATED] Prometheus exporter for VPA recommendations☆12Aug 22, 2023Updated 3 years ago
- CLI for the Serverless Supercomputer☆25Sep 17, 2025Updated last year
- An SRIOV device plugin plugin☆15Aug 17, 2026Updated 2 months ago
- Container Level Energy-efficient VPA Recommender☆28Mar 19, 2026Updated 6 months ago
- Nabla Containers blog☆12May 26, 2021Updated 5 years ago
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆82Updated this week
- Holistic job manager on Kubernetes☆117Feb 20, 2024Updated 2 years ago
- Deploy Sourcegraph to a Kubernetes (k8s) cluster with Kustomize for large-scale code search and intelligence☆17Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Apr 7, 2020Updated 6 years ago
- Local Prometheus and Grafana: work with metrics during development☆15Aug 5, 2025Updated last year
- Explore external scalers built by the community.☆12Sep 16, 2026Updated last month
- Community maintained hardware plugin for vLLM on Spyre☆53Oct 1, 2026Updated 2 weeks ago
- Solution Service Architecture☆26Jun 5, 2024Updated 2 years ago
- Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling☆277Updated this week
- GenAI inference performance benchmarking tool☆265Updated this week
- 📍~/. my dotfiles ⚙️ for macOS, iterm2, git, vim, zsh, stow☆10Mar 31, 2026Updated 6 months ago
- Set up your GitHub Actions workflow with a specific version of Minikube and Kuberentes☆63Oct 10, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Mar 11, 2026Updated 7 months ago
- Following the same workflows as Kubernetes. Widely used in InftyAI community.☆12Aug 17, 2026Updated 2 months ago
- llm-d helm charts and deployment examples☆59May 1, 2026Updated 5 months ago
- Repository for out-of-tree scheduler plugins based on scheduler framework.☆11Jul 4, 2026Updated 3 months ago
- A simple GPU reservation tool for single host shared development systems☆32Aug 24, 2026Updated last month
- Fauxpenshift is a Kubernetes Cluster + The OpenShift Router. That's it!☆23Nov 19, 2022Updated 3 years ago
- A framework for designing, executing and analysing experiment campaigns☆65Updated this week