Skip to content
pdscomp / llama-dockerView on GitHub
🦙 Docker template for running llama.cpp llama-server in router mode with NVIDIA CUDA and AMD Vulkan GPU acceleration. Features TurboQuant KV cache optimization, long context support (up to 256K tokens), and optimized configurations for 24GB+ VRAM cards.
☆10Jun 25, 2026Updated 4 months ago

Alternatives and similar repositories for llama-docker

Users that are interested in llama-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?