Alternatives and similar repositories for llama-runner

Users that are interested in llama-runner are comparing it to the libraries listed below

• boneylizard / Eloquent
  A local front-end for open-weight LLMs with memory, RAG, TTS/STT, Elo ratings, and dynamic research tools. Built with React and FastAPI.
  ☆40Updated 5 months ago
• rhulha / Speech2Speech
  A web application that converts speech to speech 100% private
  ☆81Updated 7 months ago
• thushan / olla
  High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…
  ☆124Updated 2 weeks ago
• PkmX / orpheus-chat-webui
  Orpheus Chat WebUI
  ☆74Updated 9 months ago
• yazon / flexllama
  🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…
  ☆46Updated last month
• TesslateAI / TFrameX
  ☆176Updated 4 months ago
• TAR-ALEX / llm-html
  ☆19Updated 6 months ago
• wsmlby / homl
  The easiest & fastest way to run LLMs in your home lab
  ☆75Updated last month
• savantskie / persistent-ai-memory
  A persistent local memory for AI, LLMs, or Copilot in VS Code.
  ☆183Updated 2 months ago
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆22Updated 9 months ago
• quentin-r37 / sortify-ai
  ☆58Updated 10 months ago
• KartDriver / mira_converse
  ☆83Updated 10 months ago
• MehulG / memX
  A real-time shared memory layer for multi-agent LLM systems.
  ☆50Updated 6 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆86Updated this week
• dkruyt / webollama
  A sleek web interface for Ollama, making local LLM management and usage simple. WebOllama provides an intuitive UI to manage Ollama model…
  ☆59Updated 2 months ago
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆90Updated this week
• PasiKoodaa / dia
  A TTS model capable of generating ultra-realistic dialogue in one pass.
  ☆31Updated 8 months ago
• k-koehler / gguf-tensor-overrider
  ☆50Updated 2 months ago
• navedmerchant / MyDeviceAI
  A cross platform App that gives you the best UX to run models locally or remotely on your own hardware
  ☆70Updated 2 weeks ago
• 3-ark / Cognito-AI_Sidekick
  Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.
  ☆56Updated last month
• PasiKoodaa / ACE-Step-RADIO
  ACE-Step: A Step Towards Music Generation Foundation Model
  ☆46Updated 7 months ago
• SlerpE / highCompute.py
  ☆28Updated 6 months ago
• Toy-97 / Chat-WebUI
  Chat WebUI is an easy-to-use user interface for interacting with AI, and it comes with multiple useful built-in tools such as web search …
  ☆47Updated 4 months ago
• ideaweaver-ai-code / ideaweaver
  ☆62Updated 6 months ago
• tisu19021997 / snipai
  Capture, tag, and search images locally with OSS models.
  ☆44Updated 11 months ago
• moaljumaa / halfwayml_open
  Open source tool for transcirption and subtitling, alternative to happyscribe.
  ☆31Updated 10 months ago
• tarun7r / deep-research-agent
  Multi-agent autonomous research system using LangGraph and LangChain. Generates citation-backed reports with credibility scoring and web …
  ☆117Updated this week
• thooton / aspen
  Personal voice assistant, with voice interruption and Twilio support
  ☆18Updated 10 months ago
• matteoserva / GraphLLM
  ☆210Updated 3 months ago
• callbacked / qwen3-semantic-search
  interactive semantic search demo using Qwen3-0.6B-Embedding in your browser
  ☆54Updated 6 months ago