Alternatives and similar repositories for docker-llama.cpp-rpc

Users that are interested in docker-llama.cpp-rpc are comparing it to the libraries listed below

• EvilFreelancer / docker-whisper-server
  whisper.cpp HTTP transcription server with OpenAI-like API in Docker
  ☆28Updated 5 months ago
• bold84 / cot_proxy
  Smart proxy for LLM APIs that enables model-specific parameter control, automatic mode switching (like Qwen3's /think and /no_think), and…
  ☆50Updated 8 months ago
• dialoqbase / dialoqbase-lite
  Dialoqbase Lite is a Chrome extension that offers a web-based UI and a side panel, Copilot, designed specifically for almost all AI provi…
  ☆43Updated 9 months ago
• matthewhand / openai-f5-tts
  This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …
  ☆14Updated 5 months ago
• AgentOps-AI / Spellcaster
  AI agent to automatically check grammar and spelling on documentation files
  ☆94Updated 2 months ago
• calmstate / Itinerant
  A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.
  ☆17Updated last year
• SulemanKazi / TtYT
  Talk to YouTube
  ☆41Updated 2 years ago
• zyndai / hector-rag
  Hector RAG is a modular RAG framework built on PostgreSQL, offering advanced retrieval methods and fusion techniques for AI-driven applic…
  ☆60Updated 11 months ago
• thushan / olla
  High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model di…
  ☆131Updated last week
• kroko-ai / kroko-onnx
  Kroko ASR - Speech-to-text
  ☆130Updated 3 months ago
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆39Updated 2 years ago
• exactlab / exact-rag
  AI-augmented, conversational information retrieval and data exploration
  ☆37Updated last year
• BeehiveHQ / beehive-ai
  🐝 Create powerful, collaborative AI applications.
  ☆65Updated last year
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆59Updated last year
• VikhrModels / mctslib
  ☆31Updated last year
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆121Updated last year
• IlyaGusev / saiga
  Training and data processing code for Saiga
  ☆54Updated 3 weeks ago
• VikhrModels / Salt
  ☆60Updated last month
• ma2za / telegram-llm-bot
  Telegram LLM bot backed by OpenAI, Whisper, Beam, LLaMA, Weaviate, MinIO and MongoDB
  ☆109Updated 2 years ago
• chigkim / prompt-test
  ☆18Updated 8 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• EvilFreelancer / docker-fish-speech-server
  OpenAPI-like API-server for voice generation (TTS) based on fish-speech-1.5 model.
  ☆29Updated 8 months ago
• langchain-ai / langchain-elastic
  Elasticsearch integration into LangChain
  ☆72Updated last month
• jonasfrey / gpu-monitor-browser-gui
  a browser gui for nvidia smi
  ☆20Updated 10 months ago
• NVIDIA / NeMo-Inspector
  A tool for an analysis of LLM generations.
  ☆42Updated 3 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• Mozer / russian-llm-top
  best llms in russian
  ☆62Updated last year
• TikkunCreation / llama-2-resources
  Useful tools and links for Llama 2.
  ☆48Updated 2 years ago
• Zackriya-Solutions / diagram2graph
  An AI Vision Language Model System for extracting structured knowledge graph information(JSON) from images of process diagrams
  ☆38Updated 9 months ago
• sshh12 / llm-chat-web-ui
  LLM Chat is an open-source serverless alternative to ChatGPT.
  ☆36Updated last year