microsoft / ParrotServe

[OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
109Updated last month

Related projects

Alternatives and complementary repositories for ParrotServe