replicate / cog-vllm

Run LLMs on Replicate with vLLM
16Updated 5 months ago

Alternatives and similar repositories for cog-vllm:

Users that are interested in cog-vllm are comparing it to the libraries listed below