Alternatives and similar repositories for llama-cpp-runner

Users that are interested in llama-cpp-runner are comparing it to the libraries listed below

• open-webui / community-platform
  ☆16Updated 7 months ago
• open-webui / extension
  WIP: Open WebUI Chrome Extension (Requires Open WebUI v0.2.0+)
  ☆135Updated last year
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆67Updated last week
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 6 months ago
• phildougherty / mcp-compose
  Run and manage MCP servers as Docker containers with a unified HTTP endpoint. Inspired by Docker compose.
  ☆35Updated 3 weeks ago
• AlgorithmicKing737 / orpheus-tts-local-openai
  Run Orpheus 3B Locally With LM Studio
  ☆31Updated 3 months ago
• 3-ark / Cognito-AI_Sidekick
  Cognito: Supercharge your Chrome browser with AI. Guide, query, and control everything using natural language.
  ☆51Updated this week
• rodrigobaron / anthill
  ☆24Updated 5 months ago
• open-webui / assistant
  No longer actively being worked on, Please use https://github.com/open-webui/extension instead
  ☆29Updated last year
• cocktailpeanut / deeperhermes
  deep hermes, but decides how to respond based on its OWN decision, no need for system prompts.
  ☆36Updated 2 months ago
• flamingrickpat / private-machine
  I'll be your machinery.
  ☆16Updated this week
• blascerecer / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆99Updated 3 months ago
• atgehrhardt / Cerebro-OpenWebUI-Package-Manager
  A third-party package manager for OpenWebUI
  ☆31Updated 11 months ago
• phildougherty / llmsh
  *NIX SHELL with Local AI/LLM integration
  ☆23Updated 4 months ago
• daswer123 / mcpo-control-panel
  Web UI and API for managing MCP Orchestrator (mcpo) instances and configurations
  ☆72Updated last month
• lorenzodimauro97 / FileCollector
  ☆13Updated 2 weeks ago
• SlerpE / highCompute.py
  ☆28Updated 2 weeks ago
• Oct4Pie / toolbridge
  Enable tool/function calling for any LLM, in OpenAI and Ollama API formats, adding universal function calling to models without native su…
  ☆41Updated last month
• theroyallab / YALS
  ☆78Updated this week
• TesslateAI / Studio
  ☆104Updated last month
• MartianInGreen / OpenWebUI-Tools
  Tools for OpenWebUI
  ☆95Updated last month
• PkmX / orpheus-chat-webui
  Orpheus Chat WebUI
  ☆65Updated 2 months ago
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆65Updated 2 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 9 months ago
• Edw590 / VISOR---A-Voice-Assistant
  V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!
  ☆37Updated 2 months ago
• yazon / flexllama
  🚀 FlexLLama - Lightweight self-hosted tool for running multiple llama.cpp server instances with OpenAI v1 API compatibility and multi-GP…
  ☆21Updated 2 weeks ago
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆62Updated this week
• promptmesh / easymcp
  A high performance MCP client sdk for python
  ☆19Updated 2 months ago
• Belluxx / LocalAIME
  Test your local LLMs on the AIME problems
  ☆28Updated 2 weeks ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆31Updated this week