duydvu / triton-inference-server-web-ui

Related projects ⓘ

Alternatives and complementary repositories for triton-inference-server-web-ui

• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆52Updated last year
• npuichigo / openai_trtllm
  OpenAI compatible API for TensorRT LLM triton backend
  ☆177Updated 3 months ago
• bytedance / decoupleQ
  A quantization algorithm for LLM
  ☆101Updated 5 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆137Updated 2 months ago
• 01-ai / Descartes
  ☆100Updated 7 months ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆62Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆133Updated this week
• Eddie-Wang1120 / Eddie-Wang-Hackathon2023
  Whisper inference with TensorRT-LLM
  ☆21Updated last year
• chenyangMl / keyword-spot
  端到端语音唤醒工具箱，从模型训练到模型推理。
  ☆77Updated 2 months ago
• mlc-ai / tokenizers-cpp
  Universal cross-platform tokenizers binding to HF and sentencepiece
  ☆274Updated last week
• triton-inference-server / vllm_backend
  ☆192Updated this week
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆97Updated 5 months ago
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆295Updated this week
• yuekaizhang / Triton-ASR-Client
  ASR client for Triton ASR Service
  ☆19Updated last month
• lovemefan / SenseVoice-python
  SenseVoice-python: A enterprise-grade open source multi-language asr system from funasr opensource with onnxruntime
  ☆74Updated last month
• csukuangfj / onnxruntime-libs
  onnxruntime pre-compiled libs
  ☆81Updated this week
• daquexian / faster-rwkv
  ☆123Updated 11 months ago
• triton-inference-server / paddlepaddle_backend
  ☆32Updated 9 months ago
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆44Updated 8 months ago
• justinchuby / model-explorer-onnx
  ONNX Adapter for model-explorer
  ☆25Updated last month
• triton-inference-server / perf_analyzer
  ☆24Updated this week
• jingzhunxue / flow_mirror
  flow mirror models from JZX AI Labs
  ☆40Updated last month
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• zzk0 / triton
  Triton Inferece Server Model Config and Client Scripts
  ☆31Updated 2 years ago
• tpoisonooo / llama.onnx
  LLaMa/RWKV onnx models, quantization and testcase
  ☆353Updated last year
• lovemefan / fsmn-vad
  A enterprise-grade Voice Activity Detector from modelscope and funasr.
  ☆66Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆48Updated 8 months ago
• OpenBMB / cpm_kernels
  ☆23Updated last year
• neuralmagic / AutoFP8
  ☆158Updated last month