Alternatives and similar repositories for triton-inference-server-web-ui

Users that are interested in triton-inference-server-web-ui are comparing it to the libraries listed below

• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆74Updated last week
• lovemefan / fsmn-vad
  A enterprise-grade Voice Activity Detector from modelscope and funasr.
  ☆102Updated 2 years ago
• Eddie-Wang1120 / Eddie-Wang-Hackathon2023
  Whisper inference with TensorRT-LLM
  ☆22Updated last year
• lovemefan / paraformer.cpp
  Port of Funasr's Paraformer model in C/C++
  ☆32Updated last year
• lovemefan / paraformer-python
  paraformer(chinense asr) online onnx runtime for python
  ☆46Updated last year
• wangzhaode / mnn-asr
  mnn asr demo.
  ☆20Updated 3 months ago
• triton-inference-server / vllm_backend
  ☆267Updated 2 weeks ago
• RapidAI / RapidTTS
  A cross platform implementation of Text-to-Speech based on ONNXRuntime.
  ☆32Updated 2 years ago
• jack139 / go-infer
  Go framework for DL model inference and API deployment
  ☆49Updated 6 months ago
• wenet-e2e / wesr
  We Speech Transcript based on LLM, in 300 lines of code.
  ☆164Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆153Updated last week
• StudyingLover / ggml-tutorial
  ☆31Updated 9 months ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆77Updated last week
• DoodleBears / split-lang
  ✨ Split text by languages (e.g. 你喜欢看アニメ吗 -> 你喜欢看 | アニメ | 吗) for NLP tasks (e.g. parse, TTS). Powered by fasttext and budoux
  ☆61Updated 4 months ago
• lovemefan / SenseVoice-python
  SenseVoice-python: A enterprise-grade open source multi-language asr system from funasr opensource with onnxruntime
  ☆95Updated 9 months ago
• 01-ai / Descartes
  ☆109Updated last year
• DakeQQ / Audio-Denoiser-ONNX
  Utilizes ONNX Runtime for audio denoising.
  ☆55Updated this week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆256Updated 3 weeks ago
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆328Updated last week
• wangyifan2018 / ChatDoc-TPU
  适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆12Updated last year
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆159Updated this week
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆209Updated 10 months ago
• seasonjs / rwkv
  pure go for rwkv
  ☆19Updated last year
• zhaochenyang20 / ModelServer
  Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang
  ☆53Updated 7 months ago
• dengcunqin / noise-reduction
  noise reduction
  ☆17Updated 11 months ago
• csukuangfj / kaldi-native-fbank
  Kaldi-compatible online fbank extractor without external dependencies
  ☆107Updated this week
• pengzhendong / pyannote-onnx
  ONNX Inference of Pyannote Segmentation
  ☆91Updated 6 months ago
• ling0322 / libllm
  Efficient inference of large language models.
  ☆148Updated last week
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆67Updated 2 years ago
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆64Updated 2 weeks ago