YirongMao / TensorRT-Custom-PluginLinks
This repository describes how to add a custom TensorRT plugin in c++ and python
☆29Updated 4 years ago
Alternatives and similar repositories for TensorRT-Custom-Plugin
Users that are interested in TensorRT-Custom-Plugin are comparing it to the libraries listed below
Sorting:
- This project aims to explore the deployment of Swin-Transformer based on TensorRT, including the test results of FP16 and INT8.☆174Updated 3 years ago
- A simple tool that can generate TensorRT plugin code quickly.☆238Updated 2 years ago
- ☆70Updated 3 years ago
- Useful tensorrt plugin. For pytorch and mmdetection model conversion.☆165Updated last year
- Offline Quantization Tools for Deploy.☆141Updated 2 years ago
- Simple demo of tensorrt plugin☆44Updated 4 years ago
- NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.☆224Updated last year
- A sample for onnxparser working with trt user defined plugins for TRT7.0☆171Updated 5 years ago
- Count number of parameters / MACs / FLOPS for ONNX models.☆95Updated last year
- TensorRT 2022复赛方案: 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆143Updated 3 years ago
- PyTorch Quantization Aware Training Example☆150Updated last year
- resize image in (CUDA, python, cupy)☆41Updated 2 years ago
- YOLOv5 on Orin DLA☆219Updated last year
- A tool convert TensorRT engine/plan to a fake onnx☆41Updated 3 years ago
- NVIDIA-阿里2021 TRT比赛 `二等奖` 代码提交 团队:美迪康 AI Lab☆174Updated 3 years ago
- A pytorch to tensorrt convert with dynamic shape support☆267Updated last year
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆78Updated 7 months ago
- MegEngine到其他框架的转换器☆70Updated 2 years ago
- ☆45Updated 3 years ago
- A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…☆303Updated last year
- Inference of quantization aware trained networks using TensorRT☆82Updated 2 years ago
- High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI☆161Updated last week
- Deep Learning tools and applications for NVIDIA AGX platforms.☆261Updated 4 months ago
- Implement popular deep learning networks in pytorch, used by tensorrtx.☆197Updated 4 years ago
- A parser, editor and profiler tool for ONNX models.☆473Updated 2 months ago
- 基于TensorRT7实现DCNv2插件☆48Updated 3 years ago
- A tutorial for getting started with the Deep Learning Accelerator (DLA) on NVIDIA Jetson☆362Updated 3 years ago
- TensorRT plugin forDCNv2 layer in ONNX model☆61Updated 5 years ago
- ☆81Updated 5 years ago
- Make RepVGG Greater Again: A Quantization-aware Approach☆28Updated last year