linzm1007 / nano-vllm-ascendView on GitHub
nano-vllm是开源的一个gpu推理项目,基于开源版本弄的一个ascend npu版本推理小demo,旨在帮助初学者了解推理的整体流程,区别于vllm,nano-vllm体量更小,麻雀虽小五脏俱全,更有助于初学者学习。
30Feb 14, 2026Updated last month

Alternatives and similar repositories for nano-vllm-ascend

Users that are interested in nano-vllm-ascend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?