EricLBuehler / candle-vllmLinks

Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
372Updated this week

Alternatives and similar repositories for candle-vllm

Users that are interested in candle-vllm are comparing it to the libraries listed below

Sorting: