tensorchord / openmodelzLinks

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
267Updated last year

Alternatives and similar repositories for openmodelz

Users that are interested in openmodelz are comparing it to the libraries listed below

Sorting: