bjodah / llm-multi-backend-container

Docker/podman container for llama.cpp/vllm/exllamav2 orchestrated using llama-swap
11Updated this week

Alternatives and similar repositories for llm-multi-backend-container

Users that are interested in llm-multi-backend-container are comparing it to the libraries listed below

Sorting: