thushan / ollaLinks

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
112Updated last week

Alternatives and similar repositories for olla

Users that are interested in olla are comparing it to the libraries listed below

Sorting: