bjodah / llm-multi-backend-containerLinks

Docker/podman container for llama.cpp/vllm/exllamav{2,3} orchestrated using llama-swap
16Updated last month

Alternatives and similar repositories for llm-multi-backend-container

Users that are interested in llm-multi-backend-container are comparing it to the libraries listed below

Sorting: