AlibabaPAI / llumnixLinks

Efficient and easy multi-instance LLM serving
497Updated last month

Alternatives and similar repositories for llumnix

Users that are interested in llumnix are comparing it to the libraries listed below

Sorting: