zhihu / ZhiLight
View external linksLinks

A highly optimized LLM inference acceleration engine for Llama and its variants.
906Updated this week

Alternatives and similar repositories for ZhiLight

Users that are interested in ZhiLight are comparing it to the libraries listed below

Sorting:

Are these results useful?