This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
☆284Jun 2, 2022Updated 3 years ago
Alternatives and similar repositories for yolov4-triton-tensorrt
Users that are interested in yolov4-triton-tensorrt are comparing it to the libraries listed below
Sorting:
- ☆53Jan 24, 2022Updated 4 years ago
- 服务侧深度学习部署案例☆455Mar 27, 2020Updated 5 years ago
- Implementation of popular deep learning networks with TensorRT network definition API☆7,695Updated this week
- NVIDIA DeepStream SDK 8.0 / 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models☆1,953Jan 25, 2026Updated last month
- TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet☆1,791Sep 2, 2025Updated 6 months ago
- ☆718Aug 23, 2023Updated 2 years ago
- How to deploy open source models using DeepStream and Triton Inference Server☆86Jun 27, 2024Updated last year
- yolo model qat and deploy with deepstream&tensorrt☆593Sep 25, 2024Updated last year
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆29Jan 7, 2021Updated 5 years ago
- ☆53Mar 2, 2022Updated 4 years ago
- Describe how to use yolov5 in Deepstream 5.0☆209Oct 17, 2023Updated 2 years ago
- Sample apps to demonstrate how to deploy models trained with TAO on DeepStream☆440Nov 4, 2025Updated 4 months ago
- triton server ensemble model demo☆30May 2, 2022Updated 3 years ago
- TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is usef…☆1,200Mar 9, 2023Updated 3 years ago
- A project demonstrating how to use nvmetamux to run multiple models in parallel.☆113Oct 18, 2024Updated last year
- ☆16Dec 20, 2021Updated 4 years ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,406Updated this week
- yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.☆729Feb 9, 2026Updated last month
- A shared library of on-demand DeepStream Pipeline Services for Python and C/C++☆336Mar 17, 2025Updated 11 months ago
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆534Jul 17, 2021Updated 4 years ago
- Samples for TensorRT/Deepstream for Tesla & Jetson☆1,288Oct 16, 2025Updated 4 months ago
- deploy yolox algorithm use deepstream☆91Dec 20, 2021Updated 4 years ago
- Triton Inferece Server Model Config and Client Scripts☆32Jan 7, 2022Updated 4 years ago
- DeepStream SDK Python bindings and sample applications☆1,795Oct 14, 2025Updated 4 months ago
- 包含目标检测前处理与后处理☆20Aug 24, 2021Updated 4 years ago
- TensorRT ONNX Plugin、Inference、Compile☆464Jul 26, 2021Updated 4 years ago
- An easy to use PyTorch to TensorRT converter☆4,856Aug 17, 2024Updated last year
- ☆23Nov 2, 2022Updated 3 years ago
- Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxn…☆210Aug 2, 2021Updated 4 years ago
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆600Feb 18, 2024Updated 2 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆141Feb 26, 2026Updated last week
- ☆241Nov 29, 2022Updated 3 years ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆49Sep 30, 2021Updated 4 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,194Feb 3, 2026Updated last month
- 🔥🔥🔥 🔥🔥🔥Docker NVIDIA Docker2 YOLOV5 YOLOX YOLO Deepsort TensorRT ROS Deepstream Jetson Nano TX2 NX for High-performance deployment(高…☆536Sep 15, 2022Updated 3 years ago
- Sample app code for LPR deployment on DeepStream☆228Oct 18, 2024Updated last year
- YOLOv3、YOLOv4、YOLOv5、YOLOv5-Lite、YOLOv6-v1、YOLOv6-v2、YOLOv7、YOLOX、YOLOX-Lite、PP-YOLOE、PP-PicoDet-Plus、YOLO-Fastest v2、FastestDet、YOLOv5-S…☆765Oct 25, 2022Updated 3 years ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,956Updated this week
- Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms☆721Aug 8, 2023Updated 2 years ago