LLMServe / DistServe

Disaggregated serving system for Large Language Models (LLMs).
348Updated 2 months ago

Related projects

Alternatives and complementary repositories for DistServe