This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
☆283Jun 2, 2022Updated 4 years ago
Alternatives and similar repositories for yolov4-triton-tensorrt
Users that are interested in yolov4-triton-tensorrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 服务侧深度学习部署案例☆453Mar 27, 2020Updated 6 years ago
- ☆53Jan 24, 2022Updated 4 years ago
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆29Jan 7, 2021Updated 5 years ago
- Implementation of popular deep learning networks with TensorRT network definition API☆7,817Jul 11, 2026Updated 2 weeks ago
- How to deploy open source models using DeepStream and Triton Inference Server☆87Jun 27, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- NVIDIA DeepStream SDK 8.0 / 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models☆2,046Jan 25, 2026Updated 6 months ago
- ☆718Aug 23, 2023Updated 2 years ago
- ☆54Mar 2, 2022Updated 4 years ago
- triton server ensemble model demo☆30May 2, 2022Updated 4 years ago
- yolo model qat and deploy with deepstream&tensorrt☆606Sep 25, 2024Updated last year
- TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet☆1,792Sep 2, 2025Updated 10 months ago
- Describe how to use yolov5 in Deepstream 5.0☆208Oct 17, 2023Updated 2 years ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,881Updated this week
- ☆16Dec 20, 2021Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A project demonstrating how to use nvmetamux to run multiple models in parallel.☆115Oct 18, 2024Updated last year
- Triton Inferece Server Model Config and Client Scripts☆31Jan 7, 2022Updated 4 years ago
- TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is usef…☆1,203Apr 12, 2026Updated 3 months ago
- Sample apps to demonstrate how to deploy models trained with TAO on DeepStream☆455Jul 15, 2026Updated 2 weeks ago
- yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.☆730Apr 10, 2026Updated 3 months ago
- A shared library of on-demand DeepStream Pipeline Services for Python and C/C++☆345Mar 17, 2025Updated last year
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆536Jul 17, 2021Updated 5 years ago
- 包含目标检测前处理与后处理☆20Aug 24, 2021Updated 4 years ago
- DeepStream SDK Python bindings and sample applications☆1,872Apr 1, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆25Oct 10, 2022Updated 3 years ago
- Samples for TensorRT/Deepstream for Tesla & Jetson☆1,348Jul 15, 2026Updated 2 weeks ago
- An easy to use PyTorch to TensorRT converter☆4,878Aug 17, 2024Updated last year
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆147Updated this week
- deploy yolox algorithm use deepstream☆91Dec 20, 2021Updated 4 years ago
- TensorRT ONNX Plugin、Inference、Compile☆463Jul 26, 2021Updated 5 years ago
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆597Feb 18, 2024Updated 2 years ago
- ☆33Jul 7, 2022Updated 4 years ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆49Sep 30, 2021Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms☆720Aug 8, 2023Updated 2 years ago
- A tensorrt implementation of yolov5: https://github.com/ultralytics/yolov5☆193Oct 4, 2020Updated 5 years ago
- Set of Python bindings to C++ libraries which provides full HW acceleration for video decoding, encoding and GPU-accelerated color space …☆1,378Jun 10, 2024Updated 2 years ago
- Deploy your model with TensorRT quickly.☆763Nov 21, 2023Updated 2 years ago
- PyTorch ,ONNX and TensorRT implementation of YOLOv4☆4,524Jun 19, 2024Updated 2 years ago
- Got 100fps on TX2. Got 500fps on GeForce GTX 1660 Ti. If the project is useful to you, please Star it.☆177Feb 22, 2023Updated 3 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,219Jun 22, 2026Updated last month