Alternatives and similar repositories for llama-runner

Users that are interested in llama-runner are comparing it to the libraries listed below

• TAR-ALEX / llm-html
  ☆18Updated 2 months ago
• yazon / flexllama
  🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…
  ☆32Updated last month
• TesslateAI / TFrameX
  ☆165Updated last month
• quentin-r37 / sortify-ai
  ☆52Updated 7 months ago
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆78Updated this week
• boneylizard / Eloquent
  A local front-end for open-weight LLMs with memory, RAG, TTS/STT, Elo ratings, and dynamic research tools. Built with React and FastAPI.
  ☆37Updated last month
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆82Updated this week
• extopico / llama-server_mcp_proxy
  Simple node proxy for llama-server that enables MCP use
  ☆13Updated 4 months ago
• k-koehler / gguf-tensor-overrider
  ☆43Updated 2 months ago
• PkmX / orpheus-chat-webui
  Orpheus Chat WebUI
  ☆75Updated 5 months ago
• KartDriver / mira_converse
  ☆82Updated 6 months ago
• savantskie / persistent-ai-memory
  A persistent local memory for AI, LLMs, or Copilot in VS Code.
  ☆142Updated 2 weeks ago
• rhulha / Speech2Speech
  A web application that converts speech to speech 100% private
  ☆75Updated 3 months ago
• remichu-ai / pai
  Your personal and private AI
  ☆50Updated 5 months ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆63Updated last month
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆22Updated 5 months ago
• thushan / olla
  Lightweight & fast AI inference proxy for self-hosted LLMs backends like Ollama, LM Studio and others. Designed for speed, simplicity and…
  ☆87Updated last week
• victorcarre6 / llm-memorization
  Give your local LLM a real memory with a lightweight, fully local memory system. 100% offline and under your control.
  ☆57Updated this week
• MehulG / memX
  A real-time shared memory layer for multi-agent LLM systems.
  ☆47Updated 2 months ago
• AlgorithmicKing737 / orpheus-tts-local-openai
  Run Orpheus 3B Locally With LM Studio
  ☆31Updated 6 months ago
• moaljumaa / halfwayml_open
  Open source tool for transcirption and subtitling, alternative to happyscribe.
  ☆30Updated 7 months ago
• Magnetron85 / PyChat
  Python language chat with Ollama models locally, anthropic and openai
  ☆25Updated 5 months ago
• dynamiccreator / voice-text-reader
  Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)
  ☆52Updated 11 months ago
• hasaranga / NativeChat
  win32 native frontend for llama-cli
  ☆12Updated 10 months ago
• thooton / aspen
  Personal voice assistant, with voice interruption and Twilio support
  ☆18Updated 6 months ago
• intelligencedev / eternal
  Eternal is an experimental platform for machine learning models and workflows.
  ☆67Updated 6 months ago
• RobotTelevision / CrowAssistant
  Crow is a Desktop AI Assistant
  ☆31Updated last year
• taresh18 / conversify
  🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs ✨
  ☆93Updated 2 months ago
• goodreasonai / nichey
  Generate a wiki for your research topic, sourcing from the web and your docs.
  ☆52Updated 6 months ago
• ReisCook / Voice_Extractor
  Automated speech dataset creator
  ☆197Updated 3 months ago