yazon / flexllamaLinks

πŸš€ FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GPU support
β˜†23Updated last month

Alternatives and similar repositories for flexllama

Users that are interested in flexllama are comparing it to the libraries listed below

Sorting: