neuralmagic / nm-vllmLinks

A high-throughput and memory-efficient inference and serving engine for LLMs
263Updated 7 months ago

Alternatives and similar repositories for nm-vllm

Users that are interested in nm-vllm are comparing it to the libraries listed below

Sorting: