Bobo-y / triton_ensemble_model_demo
triton server ensemble model demo
☆30Updated 2 years ago
Alternatives and similar repositories for triton_ensemble_model_demo:
Users that are interested in triton_ensemble_model_demo are comparing it to the libraries listed below
- ☆53Updated 3 years ago
- ☆53Updated 3 years ago
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆28Updated 4 years ago
- Compare multiple optimization methods on triton to imporve model service performance☆50Updated last year
- Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…☆32Updated 3 years ago
- ☆16Updated 3 years ago
- How to deploy open source models using DeepStream and Triton Inference Server☆77Updated 8 months ago
- ☆25Updated 3 years ago
- scrfd使用onnxruntime-gpu跟tensorrt加速☆22Updated 2 years ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆50Updated 3 years ago
- YOLO v5 Object Detection on Triton Inference Server☆15Updated last year
- ☆24Updated 4 years ago
- Magface Triton Inferece Server Using Tensorrt☆16Updated 3 years ago
- Decode JPEG image on GPU using PyTorch☆88Updated last year
- Face Recognition with RetinaFace and ArcFace.☆81Updated 2 years ago
- ☆21Updated 2 years ago
- A project demonstrating how to use nvmetamux to run multiple models in parallel.☆98Updated 4 months ago
- Using TensorRT for Inference Model Deployment.☆47Updated last year
- This repository provides YOLOV5 GPU optimization sample☆103Updated 2 years ago
- arcface and retinaface model convert mxnet to onnx.☆60Updated 4 years ago
- Utility scripts for editing or modifying onnx models. Utility scripts to summarize onnx model files along with visualization for loop ope…☆79Updated 3 years ago
- deploy yolox algorithm use deepstream☆89Updated 3 years ago
- Retinaface get 80.99% in widerface hard val using mobilenet0.25.☆23Updated 4 years ago
- TensorRT plugin forDCNv2 layer in ONNX model☆60Updated 4 years ago
- Mobile Detection Benchmark☆43Updated 3 years ago
- resize image in (CUDA, python, cupy)☆40Updated last year
- 自然场景检测DBNet网络的tensorrt版本☆22Updated 4 years ago
- A multi object tracking Library Based on tensorrt☆53Updated 3 years ago
- Custom gst-nvinfer for alignment in Deepstream☆25Updated 3 months ago
- centernet, mobilenetv2, centerface☆52Updated 5 years ago