egbertYeah / simple_tensorrt_dynamicLinks
a simple example to learn tensorrt with dynamic shapes
☆25Updated 4 years ago
Alternatives and similar repositories for simple_tensorrt_dynamic
Users that are interested in simple_tensorrt_dynamic are comparing it to the libraries listed below
Sorting:
- ONNX2Pytorch☆165Updated 4 years ago
- Trans different platform's network to International Representation(IR)☆44Updated 7 years ago
- TensorRT 2022复赛方案: 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆143Updated 3 years ago
- ☆104Updated 4 years ago
- MegEngine到其他框架的转换器☆70Updated 2 years ago
- An Improved One millisecond Mobile Backbone☆147Updated 3 years ago
- Decode JPEG image on GPU using PyTorch☆93Updated 2 years ago
- This project aims to explore the deployment of Swin-Transformer based on TensorRT, including the test results of FP16 and INT8.☆174Updated 3 years ago
- Offline Quantization Tools for Deploy.☆142Updated 2 years ago
- ☆123Updated 4 years ago
- NVIDIA-阿里2021 TRT比赛 `二等奖` 代码提交 团队:美迪康 AI Lab☆174Updated 3 years ago
- 针对pytorch模型的自动化模型结构分析和修改工具集,包含自动分析模型结构的模型压缩算法库☆255Updated 2 years ago
- Using TensorRT for Inference Model Deployment.☆49Updated 2 years ago
- C++ and CUDA extensions for Python/Pytorch and GPU Accelerated Augmentation.☆35Updated 3 years ago
- Paddle Large Scale Classification Tools,supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT,…☆155Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- A pytorch to tensorrt convert with dynamic shape support☆266Updated last year
- quantize aware training package for NCNN on pytorch☆69Updated 4 years ago
- Useful tensorrt plugin. For pytorch and mmdetection model conversion.☆165Updated last year
- Official repo of RepOptimizers and RepOpt-VGG☆268Updated 2 years ago
- Pytorch-->onnx-->TensorRT; CUDA11, CUDNN8, TensorRT8☆212Updated 2 years ago
- ☆96Updated 3 years ago
- RepVGG TensorRT int8 量化,实测推理不到1ms一帧!☆64Updated 4 years ago
- miemienet is a C++ AI deep learning inference framework.Supports PPYOLOE、PICODET.☆12Updated 3 years ago
- A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX☆248Updated 5 years ago
- PyTorch Dataset Rank Dataset☆43Updated 4 years ago
- ☆81Updated 5 years ago
- A Toolkit to Help Optimize Large Onnx Model☆163Updated 3 months ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Updated 2 years ago
- Slides with modifications for a course at Tsinghua University.☆64Updated 3 years ago