thushan / ollaLinks

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
119Updated 2 weeks ago

Alternatives and similar repositories for olla

Users that are interested in olla are comparing it to the libraries listed below

Sorting: