⚡ Useful scripts when using TensorRT
☆237Sep 4, 2020Updated 5 years ago
Alternatives and similar repositories for tensorrt-utils
Users that are interested in tensorrt-utils are comparing it to the libraries listed below
Sorting:
- ONNX-TensorRT: TensorRT backend for ONNX☆3,188Feb 3, 2026Updated 3 weeks ago
- Implementation of popular deep learning networks with TensorRT network definition API☆7,680Updated this week
- An easy to use PyTorch to TensorRT converter☆4,857Aug 17, 2024Updated last year
- tensorrt5 , centernet , centerface, deform conv, int8☆771Oct 26, 2022Updated 3 years ago
- A sample for onnxparser working with trt user defined plugins for TRT7.0☆171Oct 11, 2020Updated 5 years ago
- A pytorch to tensorrt convert with dynamic shape support☆266Feb 18, 2024Updated 2 years ago
- TensorRT ONNX Plugin、Inference、Compile☆464Jul 26, 2021Updated 4 years ago
- Explore the Capabilities of the TensorRT Platform☆262Aug 23, 2021Updated 4 years ago
- Fast and accurate object detection with end-to-end GPU optimization☆901Sep 29, 2021Updated 4 years ago
- 服务侧深度学习部署案例☆455Mar 27, 2020Updated 5 years ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆12,723Updated this week
- volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.☆287Feb 5, 2021Updated 5 years ago
- Deploy your model with TensorRT quickly.☆764Nov 21, 2023Updated 2 years ago
- ☆52Jan 2, 2021Updated 5 years ago
- Inference of quantization aware trained networks using TensorRT☆83Jan 27, 2023Updated 3 years ago
- Simplify your onnx model☆4,297Updated this week
- Useful tensorrt plugin. For pytorch and mmdetection model conversion.☆165Oct 8, 2024Updated last year
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,947Updated this week
- TensorRT half precision inference routine on a API-based TensorRT model☆13Jul 3, 2018Updated 7 years ago
- micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantiz…☆2,271May 6, 2025Updated 9 months ago
- A set of tool which would make your life easier with Tensorrt and Onnxruntime. This Repo is designed for YoloV3☆80Dec 31, 2019Updated 6 years ago
- TensorFlow models accelerated with NVIDIA TensorRT☆692Feb 14, 2021Updated 5 years ago
- EmbedMask: Embedding Coupling for One-stage Instance Segmentation☆161Oct 13, 2021Updated 4 years ago
- TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet☆1,789Sep 2, 2025Updated 5 months ago
- Samples for TensorRT/Deepstream for Tesla & Jetson☆1,287Oct 16, 2025Updated 4 months ago
- A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX☆248Jan 29, 2021Updated 5 years ago
- Pytorch-->onnx-->TensorRT; CUDA11, CUDNN8, TensorRT8☆212Nov 16, 2023Updated 2 years ago
- This repository contains C++ implementation of A* search algorithm for finding path to goal state for 8 puzzle problem in AI.☆11Dec 2, 2023Updated 2 years ago
- TensorRT and TensorFlow demo/example (python, jupyter notebook)☆81Feb 15, 2019Updated 7 years ago
- yolo model qat and deploy with deepstream&tensorrt☆593Sep 25, 2024Updated last year
- TensorRT plugin forDCNv2 layer in ONNX model☆61Sep 28, 2020Updated 5 years ago
- A flexible Python front-end inference SDK based on TensorRT☆87Apr 30, 2021Updated 4 years ago
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆534Jul 17, 2021Updated 4 years ago
- TensorFlow/TensorRT integration☆743Nov 30, 2023Updated 2 years ago
- convert torch module to tensorrt network or tvm function☆89Dec 20, 2019Updated 6 years ago
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆600Feb 18, 2024Updated 2 years ago
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,785Mar 28, 2024Updated last year
- This is a C++ implementation of CenterNet using TensorRT and CUDA☆146Mar 3, 2023Updated 2 years ago
- TensorRT8.Support Yolov5n,s,m,l,x .darknet -> tensorrt. Yolov4 Yolov3 use raw darknet *.weights and *.cfg fils. If the wrapper is usef…☆1,200Mar 9, 2023Updated 2 years ago