lix19937 / tensorrt-insight
Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda
☆16Updated last week
Alternatives and similar repositories for tensorrt-insight:
Users that are interested in tensorrt-insight are comparing it to the libraries listed below
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆54Updated 9 months ago
- Common libraries for PPL projects☆29Updated 3 weeks ago
- A tool convert TensorRT engine/plan to a fake onnx☆38Updated 2 years ago
- inference on tvm runtime using c++ with gpu enabled☆10Updated 6 years ago
- A simple neural network inference framework☆24Updated last year
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆14Updated last year
- This is a repository to practice multi-thread programming in C++☆22Updated last year
- CUDA 6大并行计算模式 代码与笔记☆60Updated 4 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆26Updated 7 months ago
- ☆24Updated 2 years ago
- For 2022 Nvidia Hackathon☆20Updated 2 years ago
- Tencent NCNN with added CUDA support☆69Updated 4 years ago
- ☆10Updated 3 years ago
- ☆36Updated 5 months ago
- ☆17Updated 4 years ago
- ☆11Updated last year
- ☆16Updated last year
- learn TensorRT from scratch🥰☆13Updated 6 months ago
- A one-page-only CGraph-API-liked DAG project.☆17Updated last month
- YOLOv5 on Orin DLA☆196Updated last year
- ☆13Updated last year
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆12Updated 6 months ago
- snpe tutorial☆10Updated last year
- ☆23Updated 2 years ago
- arm-neon☆90Updated 8 months ago
- ☆95Updated 3 years ago
- This sample shows how to use the oneAPI Video Processing Library (oneVPL) to perform a single and multi-source video decode and preproces…☆13Updated last year
- ☆17Updated 11 months ago
- This a bridge for converting torch,and other AI training framework to C++ speed up infer library,like NCNN and ect☆20Updated 6 years ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆10Updated 3 years ago