Alternatives and similar repositories for triton-inference-server-web-ui:

Users that are interested in triton-inference-server-web-ui are comparing it to the libraries listed below

• Eddie-Wang1120 / Eddie-Wang-Hackathon2023
  Whisper inference with TensorRT-LLM
  ☆21Updated last year
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆186Updated 5 months ago
• triton-inference-server / vllm_backend
  ☆216Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆136Updated this week
• speechmatics / ctranslate2_triton_backend
  Triton backend for https://github.com/OpenNMT/CTranslate2
  ☆34Updated last year
• neuralmagic / AutoFP8
  ☆168Updated 3 months ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆65Updated this week
• bytedance / decoupleQ
  A quantization algorithm for LLM
  ☆108Updated 6 months ago
• sunhailin-Leo / triton-service-go
  Unofficial golang package for the Triton Inference Server(https://github.com/triton-inference-server/server)
  ☆45Updated this week
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆68Updated this week
• daquexian / faster-rwkv
  ☆124Updated last year
• DakeQQ / F5-TTS-ONNX
  Running the F5-TTS by ONNX Runtime
  ☆80Updated this week
• lovemefan / fsmn-vad
  A enterprise-grade Voice Activity Detector from modelscope and funasr.
  ☆71Updated last year
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆168Updated last week
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ, and export to onnx/onnx-runtime easily.
  ☆153Updated 3 months ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆30Updated 3 months ago
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆305Updated this week
• chenyangMl / keyword-spot
  端到端语音唤醒工具箱，从模型训练到模型推理。
  ☆93Updated 4 months ago
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆54Updated last year
• yuekaizhang / Triton-ASR-Client
  ASR client for Triton ASR Service
  ☆23Updated last month
• mlc-ai / tokenizers-cpp
  Universal cross-platform tokenizers binding to HF and sentencepiece
  ☆298Updated 2 months ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆30Updated this week
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆211Updated this week
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆257Updated 3 months ago
• lapp0 / lm-inference-engines
  Comparison of Language Model Inference Engines
  ☆202Updated last month
• 01-ai / Descartes
  ☆105Updated 9 months ago
• RapidAI / RapidTTS
  A cross platform implementation of Text-to-Speech based on ONNXRuntime.
  ☆31Updated last year
• PINTO0309 / whisper-onnx-tensorrt
  ONNX and TensorRT implementation of Whisper
  ☆61Updated last year
• bentoml / llm-bench
  ☆41Updated 2 months ago