Helm charts for llm-d
☆52Jul 22, 2025Updated last year
Alternatives and similar repositories for llm-d-deployer
Users that are interested in llm-d-deployer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated 9 months ago
- llm-d benchmark scripts and tooling☆66Updated this week
- llm-d Router: The intelligent entry point for inference requests☆319Updated this week
- Simplified model deployment on llm-d☆28Jul 2, 2025Updated last year
- Distributed KV cache scheduling & offloading libraries☆175Aug 25, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Test Orchestrator for Performance and Scalability of AI pLatforms☆18Jun 23, 2026Updated 2 months ago
- A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual h…☆194Updated this week
- Achieve state of the art inference performance with modern accelerators on Kubernetes☆4,400Updated this week
- Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping☆18Updated this week
- ☆28Updated this week
- Inference payload processor for llm-d☆19Aug 28, 2026Updated last week
- Let my Claude talk to yours.☆30Aug 5, 2026Updated 3 weeks ago
- Gateway API Inference Extension☆759Updated this week
- Operate-first application manifests☆52Aug 25, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Vanilla configurations for a RHOAI instance to deploy a GenAI POC. This will deploy a vector database (Milvus), a GenAI interface (Anythi…☆14Apr 18, 2025Updated last year
- Collection of demos for building Llama Stack based apps on OpenShift☆65Updated this week
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- GitHub bot to assist with the taxonomy contribution workflow☆17Nov 4, 2024Updated last year
- ☆18Updated this week
- ☆18Jun 7, 2023Updated 3 years ago
- Example app for the MCPI protocol☆10Apr 1, 2025Updated last year
- Taxonomy tree that will allow you to create models tuned with your data☆298Sep 8, 2025Updated 11 months ago
- A simple GPU reservation tool for single host shared development systems☆30Aug 24, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆44Aug 16, 2026Updated 2 weeks ago
- CLI for the Serverless Supercomputer☆25Sep 17, 2025Updated 11 months ago
- Main rossoctl repo - installer, UI and docs☆298Updated this week
- Introduction to Red Hat OpenShift AI (RHOAI)☆14Apr 11, 2024Updated 2 years ago
- ☆18Aug 20, 2026Updated 2 weeks ago
- Operator for the OpenShift Lightspeed Service☆16Updated this week
- the main repository for the multicluster global hub☆26Updated this week
- Kubernetes operator for bpfman☆38Jul 14, 2026Updated last month
- AI and cloud-native proxy server and framework☆78Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- AI Agents Workshop with Red Hat AI☆13Feb 26, 2025Updated last year
- Solution Service Architecture☆26Jun 5, 2024Updated 2 years ago
- caniuse.com, but for kubernetes☆27Dec 25, 2024Updated last year
- Examples for building and running LLM services and applications locally with Podman☆205Feb 13, 2026Updated 6 months ago
- Build and deploy Node.js application on Kubernetes☆16Sep 17, 2025Updated 11 months ago
- This repo contains the follow-along student instructions for the lab. https://rhoai-mlops.github.io/lab-instructions/☆16Jun 18, 2026Updated 2 months ago
- Variant optimization autoscaler for distributed inference workloads☆57Updated this week