Kubernetes operator for self-hosted LLM inference across a heterogeneous GPU fleet: NVIDIA CUDA, AMD Vulkan, and Apple Silicon Metal. Runtimes: llama.cpp, vLLM, TGI, mlx-server. Multi-GPU sharding, model caching, OpenAI-compatible endpoints. Apache-2.0, run across homelab and on-prem fleets, actively developed.
☆234Oct 17, 2026Updated this week
Alternatives and similar repositories for LLMKube
Users that are interested in LLMKube are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Browsable CRD docs and IDE validation schemas, straight from your Kubernetes cluster☆30Updated this week
- Exposes HTTP(S) services behind NAT, CGNAT, or dynamic IPs without opening inbound ports. Mirror from https://codeberg.org/towonel/towone…☆29Sep 16, 2026Updated last month
- A Kubernetes tool leveraging eBPF for advanced Kubernetes security, auto-generating Network Policies, Seccomp Profiles, and more.☆71Updated this week
- My GitOps home lab☆23Oct 11, 2026Updated last week
- A simple, clean AlertManager dashboard☆21Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Mirror of https://git.m00nlit.dev/m00n/homelab-cluster☆39Updated this week
- An application to manage your e-book library☆28Updated this week
- GF-approved geeked homelab k8s cluster deployed with Talos Linux; automated via FluxCD, Renovate and GitHub Actions 🤖☆35Updated this week
- Replicated block storage CSI driver for small Kubernetes clusters☆45Updated this week
- KSGate is a Kubernetes controller that manages the scheduling of pods using declarative gates and conditions☆27Nov 4, 2025Updated 11 months ago
- A Home Assistant Authentication Provider that can use Open ID☆22Nov 23, 2025Updated 10 months ago
- Kubernetes controller to upgrade Talos and Kubernetes☆322Updated this week
- YAML language server in Go. Schema-driven diagnostics, completion, hover; pluggable rendering for Flux HelmRelease and Kustomization via …☆30Updated this week
- Asynchronous data replication for Kubernetes volumes☆16Mar 22, 2026Updated 6 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Community project to mirror legacy Helm charts to OCI☆87Updated this week
- Community project for building JSON schemas to be used in Kubernetes manifests☆21Updated this week
- Jarvis is an open source web frontend for Prometheus Alertmanager — interactive, realtime, and self-hosted.☆73Updated this week
- A comprehensive AI & ML project portfolio from the University of Texas at Austin PG Program, demonstrating real-world data science and ma…☆18Jan 25, 2026Updated 8 months ago
- InfraLens is a next-generation observability tool that uses eBPF to automatically discover and visualize service-to-service communication…☆69Aug 7, 2026Updated 2 months ago
- HomeOps driven by Kubernetes and GitOps using Flux☆37Updated this week
- Yet another Keycloak Operator for Kubernetes☆15Feb 11, 2026Updated 8 months ago
- Wife tolerated HomeOps driven by Kubernetes, and Gitops via Flux.☆227Updated this week
- My homelab Kubernetes cluster☆44Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Flux resource validator and inflator ⇄☆123Updated this week
- Repo for managing kubernetes-clusters☆21Updated this week
- Kubernetes manifests for deployment to my home cluster☆45Jun 25, 2026Updated 3 months ago
- ☆16Updated this week
- The Coordination Layer for Multi-Agent AI☆661Updated this week
- My homelab baremetal-to-k8s media and "do anything" server. Codified and GitOpsified☆24Updated this week
- [READ-ONLY MIRROR] A CoreDNS plugin to resolve all types of external Kubernetes resources☆91Updated this week
- Gitops repo for my homelab☆18Updated this week
- K3s home operations☆16Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Kubernetes-Native Resource Operations☆161Updated this week
- Glorifying jank that works | JJGadgets' HomeLab monorepo☆91Updated this week
- Go framework for running OCI images as microVMs with libkrun☆30Updated this week
- Stamping out clusters like its 1999☆17Updated this week
- Variant optimization autoscaler for distributed inference workloads☆60Updated this week
- Talos TUI for real-time node monitoring, log streaming, etcd health, and diagnostics☆248Jul 24, 2026Updated 2 months ago
- Talos orchestrator by PostFinance☆185Updated this week