Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
☆251Nov 6, 2026Updated this week
Alternatives and similar repositories for LLMKube
Users that are interested in LLMKube are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- kubernetes native litellm operator☆20Updated this week
- Browsable CRD docs and IDE validation schemas, straight from your Kubernetes cluster☆35Updated this week
- Mirror of https://git.m00nlit.dev/m00n/homelab-cluster☆39Updated this week
- Replicated block storage CSI driver for small Kubernetes clusters☆47Updated this week
- Exposes HTTP(S) services behind NAT, CGNAT, or dynamic IPs without opening inbound ports. Mirror from https://codeberg.org/towonel/towone…☆31Sep 16, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A small, stateless, webhook relay☆24Updated this week
- Repository-aware AI pull request reviewer for GitHub, Forgejo, Gitea and GitLab☆35Updated this week
- Reusable GitHub Action for AI-assisted pull request review with self-hosted and cloud OpenAI-compatible models☆20Updated this week
- Kubernetes controller to upgrade Talos and Kubernetes☆335Updated this week
- A simple, clean AlertManager dashboard☆21Updated this week
- A Kopia-native Kubernetes backup operator written in Rust☆133Updated this week
- A Kubernetes tool leveraging eBPF for advanced Kubernetes security, auto-generating Network Policies, Seccomp Profiles, and more.☆72Updated this week
- An application to manage your e-book library☆28Updated this week
- A CLI for interacting with Forgejo that feels like `gh`, and implements all endpoints.☆12Oct 30, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Inflate, validate, and diff Flux resources ⇄☆134Updated this week
- Community project for shared Renovate configuration☆32Updated this week
- A read-only pull request review tool for Flux using Flate for rendering.☆72Updated this week
- A good boy.☆14Updated this week
- My GitOps home lab☆24Updated this week
- GF-approved geeked homelab k8s cluster deployed with Talos Linux; automated via FluxCD, Renovate and GitHub Actions 🤖☆36Updated this week
- Like kustomize, but for Talos!☆40Updated this week
- Wife tolerated HomeOps driven by Kubernetes, and Gitops via Flux.☆229Updated this week
- Monorepo for Starjunk and subsidiaries☆41Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Give any MCP-capable agent persistent memory: remember/recall over a tiered store with hybrid vector + keyword retrieval. Single Go binar…☆33Updated this week
- Generate Gatus endpoint configs from Kubernetes HTTPRoute, Ingress, and Service resources☆92Updated this week
- KSGate is a Kubernetes controller that manages the scheduling of pods using declarative gates and conditions☆27Nov 4, 2025Updated last year
- Asynchronous data replication for Kubernetes volumes☆16Mar 22, 2026Updated 7 months ago
- YAML language server in Go. Schema-driven diagnostics, completion, hover; pluggable rendering for Flux HelmRelease and Kustomization via …☆33Updated this week
- My homelab Kubernetes cluster☆45Updated this week
- Container images for community PostgreSQL extensions to be used as pluggable image volumes with CloudNativePG☆58Updated this week
- LLM-optimized Schema Catalog for the Kubernetes Ecosystem☆14Updated this week
- Kubernetes homelab managed with Flux GitOps☆12Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Prometheus exporter for Intel and AMD GPU utilization, memory, power, and thermals☆19Updated this week
- A handy Alpine Linux based NFS Server image running NFS v4 only, over TCP on port 2049☆22Updated this week
- A Home Assistant Authentication Provider that can use Open ID☆22Nov 23, 2025Updated 11 months ago
- Variant optimization autoscaler for distributed inference workloads☆62Oct 13, 2026Updated 3 weeks ago
- HomeOps driven by Kubernetes and GitOps using Flux☆37Updated this week
- Kubernetes cluster with Flux and Renovate☆30Updated this week
- Kubernetes-Native Resource Operations☆165Updated this week