Alternatives and similar repositories for triton-inference-server-web-ui

Users that are interested in triton-inference-server-web-ui are comparing it to the libraries listed below

• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆218Updated last year
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆177Updated 4 months ago
• wangzhaode / mnn-asr
  mnn asr demo.
  ☆23Updated 8 months ago
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆205Updated 4 months ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆77Updated this week
• KoljaB / stream2sentence
  Real-time processing and delivery of sentences from a continuous stream of characters or text chunks.
  ☆73Updated 4 months ago
• tensorchord / llmspec
  OpenAI compatible API for open source LLMs
  ☆16Updated 2 years ago
• triton-inference-server / vllm_backend
  ☆317Updated this week
• lovemefan / paraformer.cpp
  Port of Funasr's Paraformer model in C/C++
  ☆39Updated last year
• LLM-inference-router / vllm-router
  vLLM Router
  ☆51Updated last year
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆277Updated 2 years ago
• friendliai / friendli-client
  [⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI
  ☆49Updated 5 months ago
• ai-bot-pro / achatbot
  An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.
  ☆88Updated this week
• lovemefan / SenseVoice-python
  SenseVoice-python: A enterprise-grade open source multi-language asr system from funasr opensource with onnxruntime
  ☆106Updated last month
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆54Updated last year
• lovemefan / fsmn-vad
  A enterprise-grade Voice Activity Detector from modelscope and funasr.
  ☆119Updated 2 years ago
• 01-ai / Descartes
  ☆113Updated last year
• matthewhand / openai-f5-tts
  This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …
  ☆14Updated 3 months ago
• litongjava / whisper-cpp-server
  whisper-cpp-serve Real-time speech recognition and c+ of OpenAI's Whisper model in C/C++
  ☆71Updated last year
• wangyifan2018 / ChatDoc-TPU
  适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆14Updated last year
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆163Updated last year
• kyutai-labs / moshi-webrtc
  Proof of concept for running moshi/hibiki using webrtc
  ☆19Updated 9 months ago
• substratusai / vllm-docker
  ☆64Updated 8 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆79Updated last year
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆30Updated 8 months ago
• Eddie-Wang1120 / Eddie-Wang-Hackathon2023
  Whisper inference with TensorRT-LLM
  ☆23Updated 2 years ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆236Updated 11 months ago
• DakeQQ / Automatic-Speech-Recognition-ASR-ONNX
  Utilizes ONNX Runtime to transcribe audio into text.
  ☆59Updated last week
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆48Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆61Updated last year