SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
☆69Mar 4, 2026Updated 2 weeks ago
Alternatives and similar repositories for SmarterRouter
Users that are interested in SmarterRouter are comparing it to the libraries listed below
Sorting:
- FlexAudioPrint is a Python-based app for transcribing audio to text using OpenAI's Whisper model. It offers a Gradio web interface and a …☆10Jan 29, 2026Updated last month
- Quick access to any large language model from your browser.☆10Feb 16, 2026Updated last month
- Get aid from local LLMs right in your PowerShell☆15May 2, 2025Updated 10 months ago
- Scripts and tools for optimizing quantizations in llama.cpp with GGUF imatrices.☆18Jan 10, 2025Updated last year
- AI Search engine☆13Sep 24, 2025Updated 5 months ago
- Simple html ollama chatbot that is easy to install. Simply copy the html file on your computer and run it.☆48Jun 18, 2025Updated 9 months ago
- MilimoChat: Privacy-first, self-hosted AI chat with customizable personas, context-aware memory, and local analytics. Built on Python/Str…☆14Mar 12, 2025Updated last year
- Run Orpheus 3B Locally With LM Studio☆32Mar 20, 2025Updated 11 months ago
- run prometheus rootless and distroless☆18Updated this week
- Implements harmful/harmless refusal removal using pure HF Transformers☆22May 8, 2025Updated 10 months ago
- fork of litellm that is open source☆22Jan 22, 2026Updated last month
- ESP32-C6 Indoor Air Quality Sensor using the Sensirion STCC4☆48Oct 7, 2025Updated 5 months ago
- This is a TypeScript package to add tool calling capabilities to newly released LLMs on LangChain.js's ChatOpenAI and BaseChatModel class…☆19Jun 4, 2025Updated 9 months ago
- Unofficial Python client for the complete Open WebUI API.☆32Updated this week
- ☆51Oct 1, 2025Updated 5 months ago
- Mikrotik NGINX Reverse Proxy☆27May 1, 2024Updated last year
- ☆25Apr 26, 2025Updated 10 months ago
- 🎮 Material You TUI for monitoring NVIDIA GPUs☆58Jan 16, 2026Updated 2 months ago
- Run a <400ms latency Voice Agent on just 4GB VRAM. Fully offline, no API keys required. Optimized for GTX 1650 and edge robotics with zer…☆69Feb 22, 2026Updated 3 weeks ago
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆34Feb 11, 2026Updated last month
- Open WebUI tool — Give your LLM a persistent workspace with file storage, SQLite, archives, and collaboration.☆91Feb 2, 2026Updated last month
- 🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…☆52Mar 5, 2026Updated last week
- Python utilities☆18May 25, 2025Updated 9 months ago
- Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.☆38Jul 2, 2025Updated 8 months ago
- An open-source AI agent that lives in your terminal.☆30Updated this week
- High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…☆170Updated this week
- Mem0 Integration with OpenWebUI☆53Jan 19, 2026Updated last month
- Wakeword Installer for Home Assistant☆21Mar 2, 2026Updated 2 weeks ago
- Spanning Backup for Office 365 REST API PowerShell Module☆12Oct 30, 2023Updated 2 years ago
- An AI based platform for in-depth research about any topic☆31Mar 1, 2026Updated 2 weeks ago
- easily parse environment variables☆11Jul 7, 2024Updated last year
- Text to audio with Tik-Tok Voices☆13Apr 6, 2023Updated 2 years ago
- ☆18Feb 4, 2026Updated last month
- StreamlitとLangGraphで実装したHuman-in-the-loop広告コピー文生成アプリケーション☆11Feb 15, 2025Updated last year
- ☆28Jan 24, 2026Updated last month
- Coordinated Agent Team is a prompt-driven multi-agent system for autonomous software delivery. It defines clear agent roles, a determinis…☆34Feb 19, 2026Updated 3 weeks ago
- ☆18Nov 17, 2022Updated 3 years ago
- ☆14Mar 9, 2026Updated last week
- [READ ONLY] Subtree split of the siyuan-packages-monorepo (see https://github.com/Zuoqiu-Yingyi/siyuan-packages-monorepo)☆12Jan 23, 2024Updated 2 years ago