This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
☆284Jun 2, 2022Updated 3 years ago
Alternatives and similar repositories for yolov4-triton-tensorrt
Users that are interested in yolov4-triton-tensorrt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 服务侧深度学习部署案例☆454Mar 27, 2020Updated 6 years ago
- ☆53Jan 24, 2022Updated 4 years ago
- 将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型☆29Jan 7, 2021Updated 5 years ago
- Implementation of popular deep learning networks with TensorRT network definition API☆7,733Mar 7, 2026Updated 3 weeks ago
- How to deploy open source models using DeepStream and Triton Inference Server☆86Jun 27, 2024Updated last year
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆718Aug 23, 2023Updated 2 years ago
- NVIDIA DeepStream SDK 8.0 / 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models☆1,977Jan 25, 2026Updated 2 months ago
- triton server ensemble model demo☆30May 2, 2022Updated 3 years ago
- ☆53Mar 2, 2022Updated 4 years ago
- yolo model qat and deploy with deepstream&tensorrt☆592Sep 25, 2024Updated last year
- TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet☆1,790Sep 2, 2025Updated 6 months ago
- Describe how to use yolov5 in Deepstream 5.0☆209Oct 17, 2023Updated 2 years ago
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆10,472Updated this week
- A project demonstrating how to use nvmetamux to run multiple models in parallel.☆113Oct 18, 2024Updated last year
- NordVPN Special Discount Offer • AdSave on top-rated NordVPN 1 or 2-year plans with secure browsing, privacy protection, and support for for all major platforms.
- Triton Inferece Server Model Config and Client Scripts☆32Jan 7, 2022Updated 4 years ago
- Sample apps to demonstrate how to deploy models trained with TAO on DeepStream☆441Mar 18, 2026Updated last week
- TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is usef…☆1,201Mar 9, 2023Updated 3 years ago
- ☆16Dec 20, 2021Updated 4 years ago
- yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.☆730Updated this week
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆535Jul 17, 2021Updated 4 years ago
- A shared library of on-demand DeepStream Pipeline Services for Python and C/C++☆336Mar 17, 2025Updated last year
- 包含目标检测前处理与后处理☆20Aug 24, 2021Updated 4 years ago
- DeepStream SDK Python bindings and sample applications☆1,810Mar 18, 2026Updated last week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Samples for TensorRT/Deepstream for Tesla & Jetson☆1,304Mar 18, 2026Updated last week
- An easy to use PyTorch to TensorRT converter☆4,859Aug 17, 2024Updated last year
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆141Updated this week
- TensorRT ONNX Plugin、Inference、Compile☆464Jul 26, 2021Updated 4 years ago
- deploy yolox algorithm use deepstream☆91Dec 20, 2021Updated 4 years ago
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆600Feb 18, 2024Updated 2 years ago
- ☆33Jul 7, 2022Updated 3 years ago
- Implement yolov5 with Tensorrt C++ api, and integrate batchedNMSPlugin. A Python wrapper is also provided.☆49Sep 30, 2021Updated 4 years ago
- ☆24Oct 10, 2022Updated 3 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A tensorrt implementation of yolov5: https://github.com/ultralytics/yolov5☆192Oct 4, 2020Updated 5 years ago
- Deep neural network library and toolkit to do high performace inference on NVIDIA jetson platforms☆722Aug 8, 2023Updated 2 years ago
- Deploy your model with TensorRT quickly.☆764Nov 21, 2023Updated 2 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,198Updated this week
- Set of Python bindings to C++ libraries which provides full HW acceleration for video decoding, encoding and GPU-accelerated color space …☆1,378Jun 10, 2024Updated last year
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,960Updated this week
- PyTorch ,ONNX and TensorRT implementation of YOLOv4☆4,533Jun 19, 2024Updated last year