Ketonmi / Awesome-Large-Scale-LLM-ServingLinks

Must-read papers on improving efficiency for LLM serving clusters
29Updated last week

Alternatives and similar repositories for Awesome-Large-Scale-LLM-Serving

Users that are interested in Awesome-Large-Scale-LLM-Serving are comparing it to the libraries listed below

Sorting: