Bobo-y / triton_ensemble_model_demo
triton server ensemble model demo
☆30Updated 2 years ago
Alternatives and similar repositories for triton_ensemble_model_demo:
Users that are interested in triton_ensemble_model_demo are comparing it to the libraries listed below
- ☆53Updated 3 years ago
- ☆53Updated 3 years ago
- Compare multiple optimization methods on triton to imporve model service performance☆50Updated last year
- Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…☆32Updated 3 years ago
- ☆16Updated 3 years ago
- YOLO v5 Object Detection on Triton Inference Server☆15Updated last year
- ☆25Updated 3 years ago
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆28Updated 4 years ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆50Updated 3 years ago
- scrfd使用onnxruntime-gpu跟tensorrt加速☆22Updated 3 years ago
- ☆21Updated 2 years ago
- How to deploy open source models using DeepStream and Triton Inference Server☆78Updated 8 months ago
- Retinaface get 80.99% in widerface hard val using mobilenet0.25.☆23Updated 4 years ago
- Using TensorRT for Inference Model Deployment.☆47Updated last year
- deploy yolox algorithm use deepstream☆89Updated 3 years ago
- psenet,prune model, text detection☆17Updated 4 years ago
- Magface Triton Inferece Server Using Tensorrt☆16Updated 3 years ago
- tensorrt yolov7 without onnxparser☆24Updated 2 years ago