This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
☆282Jun 2, 2022Updated 4 years ago
Alternatives and similar repositories for yolov4-triton-tensorrt
Users that are interested in yolov4-triton-tensorrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 服务侧深度学习部署案例☆454Mar 27, 2020Updated 6 years ago
- ☆53Jan 24, 2022Updated 4 years ago
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆29Jan 7, 2021Updated 5 years ago
- Implementation of popular deep learning networks with TensorRT network definition API☆7,826Updated this week
- How to deploy open source models using DeepStream and Triton Inference Server☆87Jun 27, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NVIDIA DeepStream SDK 8.0 / 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models☆2,051Jan 25, 2026Updated 6 months ago
- ☆718Aug 23, 2023Updated 2 years ago
- ☆54Mar 2, 2022Updated 4 years ago
- triton server ensemble model demo☆30May 2, 2022Updated 4 years ago
- yolo model qat and deploy with deepstream&tensorrt☆607Sep 25, 2024Updated last year
- TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet☆1,792Sep 2, 2025Updated 11 months ago
- Describe how to use yolov5 in Deepstream 5.0☆208Oct 17, 2023Updated 2 years ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,926Updated this week
- ☆16Dec 20, 2021Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A project demonstrating how to use nvmetamux to run multiple models in parallel.☆116Oct 18, 2024Updated last year
- Triton Inferece Server Model Config and Client Scripts☆31Jan 7, 2022Updated 4 years ago
- TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is usef…☆1,202Apr 12, 2026Updated 4 months ago
- Sample apps to demonstrate how to deploy models trained with TAO on DeepStream☆456Jul 15, 2026Updated last month
- yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.☆729Apr 10, 2026Updated 4 months ago
- A shared library of on-demand DeepStream Pipeline Services for Python and C/C++☆344Mar 17, 2025Updated last year
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆535Jul 17, 2021Updated 5 years ago
- 包含目标检测前处理与后处理☆20Aug 24, 2021Updated 4 years ago
- DeepStream SDK Python bindings and sample applications☆1,880Apr 1, 2026Updated 4 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆25Oct 10, 2022Updated 3 years ago
- Samples for TensorRT/Deepstream for Tesla & Jetson☆1,350Jul 15, 2026Updated last month
- An easy to use PyTorch to TensorRT converter☆4,878Aug 17, 2024Updated 2 years ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆147Updated this week
- deploy yolox algorithm use deepstream☆91Dec 20, 2021Updated 4 years ago
- TensorRT ONNX Plugin、Inference、Compile☆463Jul 26, 2021Updated 5 years ago
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆596Feb 18, 2024Updated 2 years ago
- ☆33Jul 7, 2022Updated 4 years ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆49Sep 30, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms☆719Aug 8, 2023Updated 3 years ago
- A tensorrt implementation of yolov5: https://github.com/ultralytics/yolov5☆193Oct 4, 2020Updated 5 years ago
- Set of Python bindings to C++ libraries which provides full HW acceleration for video decoding, encoding and GPU-accelerated color space …☆1,378Jun 10, 2024Updated 2 years ago
- Deploy your model with TensorRT quickly.☆763Nov 21, 2023Updated 2 years ago
- PyTorch ,ONNX and TensorRT implementation of YOLOv4☆4,522Jun 19, 2024Updated 2 years ago
- Got 100fps on TX2. Got 500fps on GeForce GTX 1660 Ti. If the project is useful to you, please Star it.☆177Feb 22, 2023Updated 3 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,226Aug 3, 2026Updated 2 weeks ago