lix19937 / tensorrt-insightLinks
Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda
☆22Updated 3 weeks ago
Alternatives and similar repositories for tensorrt-insight
Users that are interested in tensorrt-insight are comparing it to the libraries listed below
Sorting:
- learn TensorRT from scratch🥰☆18Updated last year
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆77Updated 7 months ago
- This is a repository to practice multi-thread programming in C++☆26Updated last year
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆14Updated 2 years ago
- ☆14Updated 2 years ago
- PointPillars TensorRT version pretrained on MMDetection3d with WaymoOpenDataset☆21Updated 3 years ago
- A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt☆168Updated 3 years ago
- For 2022 Nvidia Hackathon☆22Updated 3 years ago
- YOLOv5 on Orin DLA☆217Updated last year
- ☆27Updated 3 years ago
- A tool convert TensorRT engine/plan to a fake onnx☆41Updated 3 years ago
- BEVFusion implementation in ROS2☆32Updated 8 months ago
- Llama3 Streaming Chat Sample☆22Updated last year
- An onnx-based quantitation tool.☆71Updated 2 years ago
- A fork of the BEVDet series .☆21Updated 2 years ago
- C++ TensorRT Implementation of NanoSAM☆48Updated 2 years ago
- Quantize yolov7 using pytorch_quantization.🚀🚀🚀☆11Updated 2 years ago
- ☆30Updated 3 years ago
- 搜藏的希望的代码片段☆13Updated 2 years ago
- NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.☆223Updated last year
- LightNet-TRT is a high-efficiency and real-time implementation of convolutional neural networks (CNNs) using Edge AI.☆75Updated 2 years ago
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆71Updated 2 years ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处 理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！☆16Updated 2 years ago
- snpe tutorial☆10Updated 2 years ago
- A simple neural network inference framework☆25Updated 2 years ago
- OpenVINO™ optimization for PointPillars*☆31Updated 8 months ago
- The real-time Instance Segmentation Algorithm Yolov7 running on TensoRT and ONNX☆24Updated 3 years ago
- A lite version based on cyber RT☆15Updated 6 months ago
- High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI☆67Updated this week
- TensorRT depth-anything for anyone and anywhere☆15Updated last year