Indras-Mirror / llama.cpp-turboq-mtpView on GitHub
Fused TBQ4 Flash Attention + MTP + Shared Tensors for llama.cpp — 82+ tok/s with lossless 4.25 bpv KV cache at 200K context on RTX 4090
84May 17, 2026Updated last month

Alternatives and similar repositories for llama.cpp-turboq-mtp

Users that are interested in llama.cpp-turboq-mtp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?