microsoft / ParrotServe

[OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
114Updated last month

Related projects

Alternatives and complementary repositories for ParrotServe