vllm-project / aibrix

Cost-efficient and pluggable Infrastructure components for GenAI inference
3,341Updated this week

Alternatives and similar repositories for aibrix:

Users that are interested in aibrix are comparing it to the libraries listed below