MrTrenchTrucker / turbohaul-managerView on GitHub
Ollama-shape inference manager using Tom's TurboQuant llama.cpp. FIFO queue + grace + IDLE_HOT hot-hold + model swap on Blackwell.
26Jul 11, 2026Updated this week

Alternatives and similar repositories for turbohaul-manager

Users that are interested in turbohaul-manager are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?