This repository give a guidline to learn CUDA and TensorRT from the beginning.
☆356Jun 14, 2026Updated 3 weeks ago
Alternatives and similar repositories for tensorrt_starter
Users that are interested in tensorrt_starter are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This is a repository to practice multi-thread programming in C++☆30Feb 21, 2024Updated 2 years ago
- learn TensorRT from scratch🥰☆18Sep 29, 2024Updated last year
- 模型部署白皮书(CUDA|ONNX|TensorRT|C++)🚀🚀🚀☆247Sep 18, 2024Updated last year
- Llama3 Streaming Chat Sample☆22Apr 24, 2024Updated 2 years ago
- A project demonstrating Lidar related AI solutions, including three GPU accelerated Lidar/camera DL networks (PointPillars, CenterPoint, …☆1,843Mar 10, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 基于TensorRT的C++高性能推理库，Yolov10, YoloPv2，Yolov5/7/X/8，RT-DETR，单目标跟踪OSTrack、LightTrack。☆235Jun 12, 2024Updated 2 years ago
- This repository is forked from shouxieai/tensorRT_Pro, extending it to support a wide range of vision models with high-performance Tensor…☆411Jun 26, 2026Updated last week
- A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt☆181Jul 24, 2022Updated 3 years ago
- An onnx-based quantitation tool.☆71Jan 8, 2024Updated 2 years ago
- 一大波学习onnx的案例☆26Sep 20, 2024Updated last year
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Mar 5, 2025Updated last year
- YOLOv5 on Orin DLA☆225Feb 18, 2024Updated 2 years ago
- C++ library based on tensorrt integration☆2,883May 24, 2023Updated 3 years ago
- Accelerating SAHI-based inference on YOLO models using TensorRT.☆103Jan 6, 2026Updated 6 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- tensorrt部署教程☆11Aug 1, 2025Updated 11 months ago
- ☆79May 16, 2023Updated 3 years ago
- ☆12Jan 25, 2023Updated 3 years ago
- Using pattern matcher in onnx model to match and replace subgraphs.☆81Feb 7, 2024Updated 2 years ago
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆88May 26, 2025Updated last year
- ☆322May 11, 2022Updated 4 years ago
- 第一章 指针篇 第二章 CUDA原理篇 第三章 CUDA编译器环境配置篇 第四章 kernel函数基础篇 第五章 kernel索引(index)篇 第六章 kenel矩阵计算实战篇 第七章 kenel实战强化篇 第八章 CUDA内存应用与性能优化篇 第九章 CUDA原子(a…☆34Aug 16, 2024Updated last year
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- A simple tool that can generate TensorRT plugin code quickly.☆242Jul 11, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- yolov5 tensorrt int8量化方法汇总☆84Dec 12, 2023Updated 2 years ago
- Multiple Lidar preprocessor for BEVfusion☆11Aug 25, 2023Updated 2 years ago
- BEVDet implemented by TensorRT, C++； Achieving real-time performance on Orin☆291Sep 13, 2023Updated 2 years ago
- TensorRT deploy and PTQ/QAT tools development for FastBEV, total time only need 6.9ms!!!☆312Dec 8, 2023Updated 2 years ago
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆70Oct 7, 2023Updated 2 years ago
- ☆56Aug 21, 2023Updated 2 years ago
- Created a simple neural network using C++17 standard and the Eigen library that supports both forward and backward propagation.☆11Jul 27, 2024Updated last year
- 10000 fps 🚀 for 360 Surround-View CUDA Solution☆152Dec 23, 2023Updated 2 years ago
- how to optimize some algorithm in cuda.☆3,118Jun 28, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- BEVFusion-ROS-TensorRT-CPP real time inference including ros1 & ros2.☆241Jan 15, 2025Updated last year
- TensorRT Acceleration for PyTorch Native Eager Mode Quantization Models☆17Jul 22, 2024Updated last year
- ☆32Aug 25, 2023Updated 2 years ago
- a plugin-oriented framework for video structured. 国产程序员请加微信zhzhi78拉群交流。☆18May 28, 2024Updated 2 years ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- this is the notes of cuda c++ programming guide, which hopes record my think in learning.☆14Sep 4, 2025Updated 10 months ago
- NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.☆234Jun 10, 2024Updated 2 years ago