xiaofeng1990 / tensorrt-tutorialLinks
tensorrt部署教程
☆11Updated 3 months ago
Alternatives and similar repositories for tensorrt-tutorial
Users that are interested in tensorrt-tutorial are comparing it to the libraries listed below
Sorting:
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Updated 8 months ago
- ☆47Updated 2 years ago
- deploy onnx models with TensorRT and LibTorch☆19Updated 4 years ago
- async inference for machine learning model☆26Updated 3 years ago
- An onnx-based quantitation tool.☆71Updated last year
- 高效部署:YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀☆52Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- 简 单快速的部署深度学习模型☆12Updated 2 years ago
- ☆30Updated last year
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆14Updated 2 years ago
- 彻底弄懂BP反向传播,15行代码,C++实现也简单,MNIST分类98.29%精度☆37Updated 3 years ago
- 跟着Tensorrt_pro学习各种知识☆40Updated 2 years ago
- ☆23Updated last year
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆70Updated 2 years ago
- ☆10Updated last year
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Updated 2 years ago
- 对 tensorRT_Pro 开源项目理解☆21Updated 2 years ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated 2 years ago
- 手摸手 美团 YOLOv6模型训练和TensorRT端到端部署方案教程☆34Updated 3 years ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Updated 10 months ago
- a simple lightweight large language model pipeline framework.☆28Updated 6 months ago
- ☆79Updated 2 years ago
- A unified and extensible pipeline for deep learning model inference with C++. Now support yolov8, yolov9, clip, and nanosam. More models …☆12Updated 3 months ago
- This is a repository to practice multi-thread programming in C++☆26Updated last year
- paper-read-notes☆14Updated last year
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆22Updated 9 months ago
- This project provides simple code and demonstrates how to use the TensorRT C++ API and ONNX to deploy PaddleOCR text recognition model.☆49Updated 3 years ago
- https://zhuanlan.zhihu.com/p/396448133☆41Updated 3 years ago
- yolov5 tensorrt int8量化方法汇总☆83Updated last year
- Serving Inside Pytorch☆165Updated this week