Alternatives and similar repositories for triton-inference-server-web-ui

Users that are interested in triton-inference-server-web-ui are comparing it to the libraries listed below

• sunhailin-Leo / triton-service-go
  Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
  ☆50Updated this week
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆215Updated last year
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆161Updated 2 months ago
• tensorchord / deepseek-api-arena
  A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.
  ☆29Updated 5 months ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆76Updated 2 weeks ago
• ml2068 / ollamagoweb
  Golang web client for Ollama, fast and easy to use.
  ☆29Updated 2 months ago
• matthewhand / openai-f5-tts
  This project provides a Flask-based API for generating high-quality text-to-speech (TTS) audio using F5-TTS, a flexible and powerful TTS …
  ☆14Updated last month
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆58Updated last week
• triton-inference-server / vllm_backend
  ☆296Updated last week
• wangzhaode / mnn-asr
  mnn asr demo.
  ☆23Updated 6 months ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆86Updated last year
• tensorchord / openmodelz
  Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)
  ☆275Updated last year
• 01-ai / Descartes
  ☆112Updated last year
• vtuber-plan / olah
  Self-hosted huggingface mirror service. 自建huggingface镜像服务。
  ☆194Updated 2 months ago
• ai-bot-pro / achatbot
  An open source chat bot architecture for voice/vision (and multimodal) assistants, local(CPU/GPU bound) and remote(I/O bound) to run.
  ☆74Updated this week
• triton-inference-server / tensorflow_backend
  The Triton backend for TensorFlow.
  ☆53Updated 3 months ago
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆53Updated last year
• milvus-io / milvus-model
  A library integrating embedding and reranker models from OpenAI, SentenceTransformers etc for semantic search in vector database.
  ☆48Updated 5 months ago
• LLM-inference-router / vllm-router
  vLLM Router
  ☆43Updated last year
• linexjlin / realtime_transcription
  ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow
  ☆32Updated last year
• Eddie-Wang1120 / Eddie-Wang-Hackathon2023
  Whisper inference with TensorRT-LLM
  ☆22Updated 2 years ago
• kubeagi / arcadia
  A diverse, simple, and secure all-in-one LLMOps platform
  ☆108Updated last year
• lovemefan / paraformer.cpp
  Port of Funasr's Paraformer model in C/C++
  ☆35Updated last year
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆68Updated 2 years ago
• daquexian / faster-rwkv
  ☆125Updated last year
• bentoml / llm-bench
  ☆56Updated 10 months ago
• OpenBMB / CPM.cu
  CPM.cu is a lightweight, high-performance CUDA implementation for LLMs, optimized for end-device inference and featuring cutting-edge tec…
  ☆194Updated last week
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆160Updated last year
• substratusai / vllm-docker
  ☆64Updated 5 months ago
• opendatahub-io / vllm-tgis-adapter
  vLLM adapter for a TGIS-compatible gRPC server.
  ☆41Updated this week