High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
☆250Jun 26, 2026Updated last week
Alternatives and similar repositories for olla
Users that are interested in olla are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The most feature-complete local AI workstation. Multi-GPU inference, integrated Stable Diffusion + ADetailer, voice cloning, research-gra…☆62Feb 24, 2026Updated 4 months ago
- personal MCPs that I use with LocalAI☆39Apr 16, 2026Updated 2 months ago
- LLm Collaboration☆12Aug 23, 2024Updated last year
- Desktop application for instant AI-powered text transformation. Translate, correct, summarize, and change the tone of any text, anywhere,…☆35Dec 29, 2025Updated 6 months ago
- AI Search engine☆13Sep 24, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Professional Wargaming LLM Toolbox☆28Jul 9, 2025Updated 11 months ago
- General-purpose planning and execution harness for LLMs — structured phases, critique, gating, and review☆94Updated this week
- Awesome LLM speech-to-speech models and frameworks☆59Nov 17, 2025Updated 7 months ago
- Model Context Protocol management suite/factory. An MCP that can generate and manage other local MCPs in multiple languages. Uses the off…☆39Aug 29, 2025Updated 10 months ago
- RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…☆86Jul 13, 2025Updated 11 months ago
- Sen Chat is a browser extension that streamlines your online experience by integrating AI chat, advanced web search, document interaction…☆42Dec 22, 2025Updated 6 months ago
- minimalist system fetch tool in V☆25Jul 30, 2025Updated 11 months ago
- An OpenRouter Frontend & Android App — Also supports API keys for Gemini, OpenAI, & Claude☆39Jun 9, 2026Updated 3 weeks ago
- Kick is an AI-powered assistant that provides voice and keyboard control over your Windows device, enabling seamless automation of your d…☆15Jul 29, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Terminal User Interface (TUI) application that enables interactive conversations with your documents using Large Language Models (LLM) …☆13Dec 11, 2024Updated last year
- 🎮 Material You TUI for monitoring NVIDIA GPUs☆57Jan 16, 2026Updated 5 months ago
- Nexus repo in GO.☆10Aug 28, 2019Updated 6 years ago
- JotItNow is a AI Voice Notes App☆26Mar 6, 2025Updated last year
- Controllable Language Model Interactions in TypeScript☆10May 17, 2024Updated 2 years ago
- Evolutionary Search for expert-level performance on any task with environmental feedback☆14Oct 12, 2025Updated 8 months ago
- FlexAudioPrint is a Python-based app for transcribing audio to text using OpenAI's Whisper model. It offers a Gradio web interface and a …☆10Apr 22, 2026Updated 2 months ago
- Deploying full-stack on-prem deep research agent that can be run entirely on a local machine for $0!☆34Nov 8, 2025Updated 7 months ago
- A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…☆79Oct 8, 2025Updated 8 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Slightly better tools for random prompt generation in ComfyUI☆11Jun 9, 2025Updated last year
- A Multi-Agentic AI Assistant/Builder☆27Jun 1, 2026Updated last month
- Simple Audit Mechanism for Rails Applications☆47May 3, 2011Updated 15 years ago
- ExternalDNS webhook to manage OPNsense Unbound DNS records☆42May 23, 2026Updated last month
- A Shiny-based demo showing how to use the igraph library of R to make impress.js/jmpress presentations☆11Oct 5, 2019Updated 6 years ago
- this is a dungeon ai run locally that use your llm in the terminal with multiple players from 2 to 5☆17Jan 25, 2026Updated 5 months ago
- Quick access to any large language model from your browser.☆10Feb 16, 2026Updated 4 months ago
- Real-time log files replication from multiple hosts over SSH☆17Apr 13, 2013Updated 13 years ago
- SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profi…☆138May 10, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Elixir/Erlang interop for ccxt library☆12Apr 1, 2019Updated 7 years ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- A simple Speech-to-Text (STT) / Text-to-Speech (TTS) wrapper for LLMs☆13Oct 22, 2024Updated last year
- Offline LLM chatbot with personalized memory — works on CPU with multi-session memory support.☆22Jan 10, 2026Updated 5 months ago
- ComfyUI custom node to extend Wan videos in loops with overlap consistency, per loop prompts, and optional LoRA control.☆32Nov 29, 2025Updated 7 months ago
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆59Dec 1, 2024Updated last year
- Static analysis toolkit for LLM agent plans☆13Aug 9, 2025Updated 10 months ago