AlibabaPAI / llumnixLinks

Efficient and easy multi-instance LLM serving
420Updated this week

Alternatives and similar repositories for llumnix

Users that are interested in llumnix are comparing it to the libraries listed below

Sorting: