Classevelabs / raiView on GitHub
CPU-only LLM inference engine in pure Rust — 4-bit quantized models, hand-written AVX2 kernels, speculative decoding, and a local HTTP/MCP server. No GPU, no Python runtime.
☆15Sep 19, 2026Updated last month

Alternatives and similar repositories for rai

Users that are interested in rai are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?