Skip to content
yeungtuzi / Xiaotu-LLMView on GitHub
XTU = X Transformers Unity — hybrid (CPU-expert + GPU) inference acceleration for vLLM: mainline plugin + CPU MoE engine (AVX512-VNNI/BF16 MXFP4/FP8), long-prefill GPU streaming, SM80 (A100) port.
☆16Nov 2, 2026Updated last week

Alternatives and similar repositories for Xiaotu-LLM

Users that are interested in Xiaotu-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?