runpod-workers / worker-vllmLinks

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
327Updated this week

Alternatives and similar repositories for worker-vllm

Users that are interested in worker-vllm are comparing it to the libraries listed below

Sorting: