Bobo-y / triton_ensemble_model_demoLinks
triton server ensemble model demo
☆30Updated 3 years ago
Alternatives and similar repositories for triton_ensemble_model_demo
Users that are interested in triton_ensemble_model_demo are comparing it to the libraries listed below
Sorting:
- ☆53Updated 3 years ago
- ☆53Updated 3 years ago
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- Retinaface get 80.99% in widerface hard val using mobilenet0.25.☆24Updated 5 years ago
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆28Updated 4 years ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆49Updated 3 years ago
- deploy yolox algorithm use deepstream☆89Updated 3 years ago
- ☆25Updated 4 years ago
- Magface Triton Inferece Server Using Tensorrt☆16Updated 3 years ago
- ☆16Updated 3 years ago
- A project demonstrating how to use nvmetamux to run multiple models in parallel.☆102Updated 8 months ago
- How to deploy open source models using DeepStream and Triton Inference Server☆80Updated 11 months ago
- 自然场景检测DBNet网 络的tensorrt版本☆22Updated 4 years ago
- TensorRT plugin forDCNv2 layer in ONNX model☆60Updated 4 years ago
- ☆22Updated 2 years ago
- Deploy RT-EDTR with onnx from paddlepaddle framwork and graph cut☆29Updated 2 years ago
- Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…☆33Updated 3 years ago
- YOLO v5 Object Detection on Triton Inference Server☆15Updated 2 years ago
- Using TensorRT for Inference Model Deployment.☆49Updated last year
- ☆24Updated 4 years ago
- yolov5s_ncnn_inference pipeline☆21Updated 4 years ago
- arcface and retinaface model convert mxnet to onnx.☆61Updated 4 years ago
- tensorrt yolov7 without onnxparser☆24Updated 2 years ago
- Guide to deploying deep-learning inference networks and deep vision primitives on Sophon TPU.☆35Updated 2 years ago
- A multi object tracking Library Based on tensorrt☆54Updated 3 years ago
- ☆11Updated 5 years ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆285Updated 3 years ago
- ☆15Updated 2 years ago
- Utility scripts for editing or modifying onnx models. Utility scripts to summarize onnx model files along with visualization for loop ope…☆79Updated 3 years ago
- ☆14Updated 2 years ago