Bobo-y / triton_ensemble_model_demo

Related projects ⓘ

Alternatives and complementary repositories for triton_ensemble_model_demo

• huynhbaobk / tensorrt-triton-yolov5
  ☆53Updated 2 years ago
• tienluongngoc / yolov5_triton_inference_server
  ☆53Updated 2 years ago
• bug-developer021 / YOLOV5_optimization_on_triton
  Compare multiple optimization methods on triton to imporve model service performance
  ☆46Updated 10 months ago
• thanhlnbka / yolov7-triton-deepstream
  ☆21Updated 2 years ago
• PhanDuc / FWorking_yolov5_deepstream_triton_6.0
  ☆16Updated 2 years ago
• k9ele7en / Triton-TensorRT-Inference-CRAFT-pytorch
  Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…
  ☆32Updated 3 years ago
• wang-xinyu / Pytorch_Retinaface
  Retinaface get 80.99% in widerface hard val using mobilenet0.25.
  ☆22Updated 4 years ago
• shining365 / EDVR-TRT
  ☆25Updated 3 years ago
• MAhaitao999 / Yolov3_Dynamic_Batch_TensorRT_Triton
  将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型
  ☆27Updated 3 years ago
• upczww / YoLov5-TensorRT-NMS
  Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.
  ☆50Updated 3 years ago
• NVIDIA-AI-IOT / deepstream_parallel_inference_app
  A project demonstrating how to use nvmetamux to run multiple models in parallel.
  ☆95Updated last month
• NVIDIA-AI-IOT / deepstream_triton_model_deploy
  How to deploy open source models using DeepStream and Triton Inference Server
  ☆74Updated 4 months ago
• nanmi / RT-DETR-Deploy
  Deploy RT-EDTR with onnx from paddlepaddle framwork and graph cut
  ☆28Updated last year
• eweill-nv / dcnv2_trt
  TensorRT plugin forDCNv2 layer in ONNX model
  ☆58Updated 4 years ago
• MACNICA-CLAVIS-NV / yolov5-triton
  YOLO v5 Object Detection on Triton Inference Server
  ☆14Updated last year
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆279Updated 2 years ago
• ZhangwenguangHikvision / YoloV5_JDE_TensorRT_for_Track
  A multi object tracking Library Based on tensorrt
  ☆52Updated 3 years ago
• royinx / CUDA_Resize
  resize image in (CUDA, python, cupy)
  ☆38Updated last year
• levipereira / yolov9-qat
  Implementation of YOLOv9 QAT optimized for deployment on TensorRT platforms.
  ☆82Updated 2 weeks ago
• nanmi / YOLOX-deepstream
  deploy yolox algorithm use deepstream
  ☆89Updated 2 years ago
• prakharg24 / yoloret
  Implementation for the paper 'YOLO-ReT: Towards High Accuracy Real-time Object Detection on Edge GPUs'
  ☆94Updated last year
• JiweiMaster / MobileDetBenchmark
  Mobile Detection Benchmark
  ☆44Updated 2 years ago
• NVIDIA-AI-IOT / yolov5_gpu_optimization
  This repository provides YOLOV5 GPU optimization sample
  ☆100Updated last year
• tonhathuy / tensorrt-triton-magface
  Magface Triton Inferece Server Using Tensorrt
  ☆15Updated 2 years ago
• DataXujing / TensorRT-DETR
  NVIDIA-阿里2021 TRT比赛 `二等奖` 代码提交 团队：美迪康 AI Lab
  ☆164Updated 2 years ago
• wangzyon / pyInfer
  async inference for machine learning model
  ☆26Updated 2 years ago
• Wulingtian / nanodet_tensorrt_int8_tools
  ☆24Updated 3 years ago
• col-in-coding / Tensorrt-CV
  Using TensorRT for Inference Model Deployment.
  ☆47Updated 10 months ago