peva3 / SmarterRouterView on GitHub
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
54Updated this week

Alternatives and similar repositories for SmarterRouter

Users that are interested in SmarterRouter are comparing it to the libraries listed below

Sorting:

Are these results useful?