Skip to content
varjoranta / turboquant-vllmView on GitHub
TurboQuant+ KV cache compression for vLLM. 3.8x smaller KV cache, same conversation quality. Fused CUDA kernels with automatic PyTorch fallback.
☆82Nov 6, 2026Updated last week

Alternatives and similar repositories for turboquant-vllm

Users that are interested in turboquant-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?