tensorchord / openmodelzLinks

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
270Updated last year

Alternatives and similar repositories for openmodelz

Users that are interested in openmodelz are comparing it to the libraries listed below

Sorting: