TylunasLi / fastllmView on GitHub
纯c++的全平台llm加速库,支持python调用,支持chatglm-6B, llama, baichuan, moss基座,x86 / ARM
12Jan 30, 2026Updated 2 months ago

Alternatives and similar repositories for fastllm

Users that are interested in fastllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?