microsoft / ParrotServe

[OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
151Updated 6 months ago

Alternatives and similar repositories for ParrotServe:

Users that are interested in ParrotServe are comparing it to the libraries listed below