substratusai / kubeai

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.
706Updated this week

Alternatives and similar repositories for kubeai:

Users that are interested in kubeai are comparing it to the libraries listed below