casys-kaist / LLMServingSim

LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale
109Updated 2 months ago

Alternatives and similar repositories for LLMServingSim:

Users that are interested in LLMServingSim are comparing it to the libraries listed below