runpod-workers / worker-vllmLinks

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
β˜†318Updated 3 weeks ago

Alternatives and similar repositories for worker-vllm

Users that are interested in worker-vllm are comparing it to the libraries listed below

Sorting: