Inference payload processor for llm-d
☆24Nov 5, 2026Updated last week
Alternatives and similar repositories for llm-d-inference-payload-processor
Users that are interested in llm-d-inference-payload-processor are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llm-d Router: The intelligent entry point for inference requests☆467Updated this week
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated last year
- the main repository for the multicluster global hub☆26Updated this week
- Proposals and discussions for the AI Gateway Working Group.☆107Sep 7, 2026Updated 2 months ago
- Distributed KV cache scheduling & offloading libraries☆195Oct 21, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Gateway API Inference Extension☆801Updated this week
- Framework for Orchestrating Runtime Gen-AI Experiments☆19Updated this week
- Fournos is a Kubernetes operator that schedules benchmark jobs via Kueue and executes them as Tekton PipelineRuns on remote clusters thro…☆18Oct 26, 2026Updated 2 weeks ago
- A comprehensive performance analysis dashboard for RHAIIS (Red Hat AI Inference server) benchmarks. This dashboard provides interactive v…☆17Nov 5, 2026Updated last week
- AI-powered analysis of vLLM benchmark data across models, versions, accelerators, and workloads.☆17Updated this week
- llm-d benchmark scripts and tooling☆79Updated this week
- Agent Builder CLI for Kubernetes.☆13Updated this week
- Span Queries: What if we had a way to plan and optimize GenAI like we do for SQL?☆14Updated this week
- ☆14Oct 14, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- llm-d-batch-gateway is a standalone, backend-agnostic, OpenAI-compatible batch API and processing engine☆28Updated this week
- Model as a Service☆48Updated this week
- General agent evaluation framework☆80Sep 15, 2026Updated last month
- ☆17Updated this week
- A chained CNI plugin that's a multi-tool for the IP command☆11Jul 14, 2022Updated 4 years ago
- Let my Claude talk to yours.☆31Oct 1, 2026Updated last month
- A Gateway for connecting application services in different domains, networks, and cloud infrastructures☆24Feb 1, 2026Updated 9 months ago
- Enhancement Tracking and Backlog Repo for Istio Releases☆16Oct 8, 2026Updated last month
- ☆111Jul 21, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- helm charts for deploying models with llm-d☆32Nov 2, 2026Updated last week
- LeaderWorkerSet & DisaggregatedSet: Kubernetes APIs for Distributed and Disaggregated AI Serving☆908Updated this week
- gpu-provisioner is a Karpenter Azure provider implementation. This project is used in Kaito to create a machine which is an Azure nodepoo…☆24Oct 31, 2026Updated last week
- The Printify API in Python☆18Updated this week
- Main rossoctl repo - installer, UI and docs☆304Updated this week
- Definition, proposals, and conformance tests for AI Conformance☆54Nov 3, 2026Updated last week
- Agentic networking policies and governance for agents and tools in Kubernetes☆122Nov 5, 2026Updated last week
- Deploys many lightweight XDS clients to generate load on an XDS server (Pilot)☆45Oct 15, 2026Updated 3 weeks ago
- Neovim API utility wrapper for more convenience with Lua keymaps, highlights, autocommands and options.☆33Oct 17, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆24Jan 28, 2025Updated last year
- Inference Platform Simulation☆57Updated this week
- State of the art inference performance with modern accelerators on Kubernetes☆5,237Updated this week
- golang nftables library☆39Sep 3, 2026Updated 2 months ago
- Repository for the score::com (with multiple bindings including LoLa), score::shared, and score::message_passing☆63Updated this week
- ☆12May 15, 2022Updated 4 years ago
- Operator for managing Node Feature Discovery deployment☆79Sep 29, 2026Updated last month
Are these results useful?