Alternatives and similar repositories for docker-llama.cpp-rpc

Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below

• EvilFreelancer / docker-whisper-server
  whisper.cpp HTTP transcription server with OpenAI-like API in Docker
  ☆27Updated 5 months ago
• IlyaGusev / holosophos
  Tools and agents for automated research.
  ☆47Updated last month
• dialoqbase / dialoqbase-lite
  Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…
  ☆43Updated 8 months ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 7 months ago
• yamalight / litlytics
  🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis
  ☆103Updated last year
• EvilFreelancer / docker-fish-speech-server
  OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.
  ☆28Updated 7 months ago
• VikhrModels / mctslib
  ☆31Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• AgentOps-AI / Spellcaster
  AI agent to automatically check grammar and spelling on documentation files
  ☆93Updated last month
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆17Updated last year
• thushan / olla
  High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…
  ☆124Updated 2 weeks ago
• kroko-ai / kroko-onnx
  Kroko ASR - Speech-to-text
  ☆123Updated 2 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆59Updated last year
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆118Updated last year
• projektjoe / GPT-OSS
  From-scratch implementation of OpenAI's GPT-OSS model in Python. No Torch, No GPUs.
  ☆107Updated 2 months ago
• sshh12 / llm-chat-web-ui
  LLM Chat is an open-source serverless alternative to ChatGPT.
  ☆35Updated last year
• matthewhand / openai-f5-tts
  This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …
  ☆14Updated 4 months ago
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆44Updated last year
• gkorepanov / whisper-stream
  Thin wrapper around OpenAI Whisper API with streaming support
  ☆86Updated last month
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆163Updated last month
• vfssantos / ffmpeg-deno-microservice
  ☆14Updated last year
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆38Updated 2 years ago
• substratusai / stapi
  Sentence Transformers API: An OpenAI compatible embedding API server
  ☆69Updated last year
• IlyaGusev / saiga
  Training and data processing code for Saiga
  ☆54Updated last week
• dkruyt / PyPlexitas
  PyPlexitas is an open-source Python CLI alternative to Perplexity AI, designed to perform web searches, scrape content, generate embeddin…
  ☆36Updated last year
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆25Updated last year
• fajrmn / kokoro-on-browser
  ☆14Updated 11 months ago
• rjalexa / wvsee
  A simple Next.js frontend to explore your local weaviate collections and data
  ☆39Updated 6 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆86Updated this week