lix19937 / tensorrt-insightLinks
Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda
☆22Updated 2 weeks ago
Alternatives and similar repositories for tensorrt-insight
Users that are interested in tensorrt-insight are comparing it to the libraries listed below
Sorting:
- This is a repository to practice multi-thread programming in C++☆27Updated last year
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆78Updated 8 months ago
- ☆27Updated 3 years ago
- High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI☆213Updated 3 weeks ago
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆14Updated 2 years ago
- learn TensorRT from scratch🥰☆18Updated last year
- ☆14Updated 2 years ago
- For 2022 Nvidia Hackathon☆22Updated 3 years ago
- A fork of the BEVDet series .☆21Updated 2 years ago
- PointPillars TensorRT version pretrained on MMDetection3d with WaymoOpenDataset☆22Updated 3 years ago
- YOLOv5 on Orin DLA☆221Updated last year
- ☆30Updated 3 years ago
- A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt☆170Updated 3 years ago
- BEVFusion implementation in ROS2☆32Updated 9 months ago
- ☆52Updated 3 weeks ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法,并重写预处理和后处理部分,具有超高性能!让你在Intel CPU平台上的检测速度起飞! 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度,推理速度更快!☆16Updated 2 years ago
- NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.☆224Updated last year
- Llama3 Streaming Chat Sample☆22Updated last year
- 搜藏的希望的代码片段☆13Updated 2 years ago
- A tool convert TensorRT engine/plan to a fake onnx☆42Updated 3 years ago
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆71Updated 2 years ago
- Python C++ Code Manager☆15Updated last year
- OpenVINO™ optimization for PointPillars*☆31Updated 8 months ago
- Quantize yolov7 using pytorch_quantization.🚀🚀🚀☆12Updated 2 years ago
- snpe tutorial☆10Updated 2 years ago
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆33Updated 3 years ago
- FastBEV-ROS-TensorRT-CPP real time inference including ros1 & ros2☆38Updated last year
- Common libraries for PPL projects☆31Updated 10 months ago
- An onnx-based quantitation tool.☆71Updated 2 years ago
- A plugin to make view transformer from perspective view to bird-eye-view, it is used in bevdet☆25Updated 2 years ago