microsoft / ParrotServe
[OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
☆154Updated 7 months ago
Alternatives and similar repositories for ParrotServe:
Users that are interested in ParrotServe are comparing it to the libraries listed below
- Stateful LLM Serving