LLMServe / DistServe

Disaggregated serving system for Large Language Models (LLMs).
359Updated 3 months ago

Related projects

Alternatives and complementary repositories for DistServe