raketenkater / llm-serverView on GitHub
Smart launcher for llama.cpp / ik_llama.cpp — auto-detects GPUs, optimizes MoE placement, crash recovery
132Apr 15, 2026Updated this week

Alternatives and similar repositories for llm-server

Users that are interested in llm-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?