This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
☆282Jun 2, 2022Updated 4 years ago
Alternatives and similar repositories for yolov4-triton-tensorrt
Users that are interested in yolov4-triton-tensorrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆29Jan 7, 2021Updated 5 years ago
- ☆53Jan 24, 2022Updated 4 years ago
- 服务侧深度学习部署案例☆455Mar 27, 2020Updated 6 years ago
- ☆54Mar 2, 2022Updated 4 years ago
- How to deploy open source models using DeepStream and Triton Inference Server☆87Jun 27, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Implementation of popular deep learning networks with TensorRT network definition API☆7,833Aug 18, 2026Updated 2 months ago
- ☆716Aug 23, 2023Updated 3 years ago
- NVIDIA DeepStream SDK 8.0 / 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models☆2,077Jan 25, 2026Updated 8 months ago
- triton server ensemble model demo☆30May 2, 2022Updated 4 years ago
- TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet☆1,793Sep 2, 2025Updated last year
- yolo model qat and deploy with deepstream&tensorrt☆610Sep 25, 2024Updated 2 years ago
- Describe how to use yolov5 in Deepstream 5.0☆208Oct 17, 2023Updated 3 years ago
- Triton Inferece Server Model Config and Client Scripts☆31Jan 7, 2022Updated 4 years ago
- A project demonstrating how to use nvmetamux to run multiple models in parallel.☆117Oct 18, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆11,110Updated this week
- Sample apps to demonstrate how to deploy models trained with TAO on DeepStream☆456Jul 15, 2026Updated 3 months ago
- ☆16Dec 20, 2021Updated 4 years ago
- TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is usef…☆1,199Apr 12, 2026Updated 6 months ago
- yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.☆730Apr 10, 2026Updated 6 months ago
- 包含目标检测前处理与后处理☆20Aug 24, 2021Updated 5 years ago
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆534Jul 17, 2021Updated 5 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆148Oct 15, 2026Updated last week
- Samples for TensorRT/Deepstream for Tesla & Jetson☆1,367Jul 15, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A shared library of on-demand DeepStream Pipeline Services for Python and C/C++☆346Mar 17, 2025Updated last year
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆596Feb 18, 2024Updated 2 years ago
- An easy to use PyTorch to TensorRT converter☆4,889Aug 17, 2024Updated 2 years ago
- DeepStream SDK Python bindings and sample applications☆1,899Apr 1, 2026Updated 6 months ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆49Sep 30, 2021Updated 5 years ago
- ☆240Nov 29, 2022Updated 3 years ago
- ☆25Oct 10, 2022Updated 4 years ago
- TensorRT ONNX Plugin、Inference、Compile☆462Jul 26, 2021Updated 5 years ago
- deploy yolox algorithm use deepstream☆90Dec 20, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms☆721Aug 8, 2023Updated 3 years ago
- Deploy your model with TensorRT quickly.☆763Nov 21, 2023Updated 2 years ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆682Updated this week
- Got 100fps on TX2. Got 500fps on GeForce GTX 1660 Ti. If the project is useful to you, please Star it.☆177Feb 22, 2023Updated 3 years ago
- Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxn…☆210Aug 2, 2021Updated 5 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,243Oct 9, 2026Updated 2 weeks ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆3,016Updated this week