Skip to content
StepfenShawn / qwen_inference_in_rustView on GitHub
Runs the Qwen3.8 27B LLM on a single CPU with >=8GB of RAM, delivering up to ~7.4 tok/s. Written in pure Rust: no BLAS, no framework, no GPU!
☆13Nov 16, 2026Updated this week

Alternatives and similar repositories for qwen_inference_in_rust

Users that are interested in qwen_inference_in_rust are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?