Huntersdeng / CXX-DeepLearning-InferenceLinks
A unified and extensible pipeline for deep learning model inference with C++. Now support yolov8, yolov9, clip, and nanosam. More models will be updated soon.
☆12Updated last year
Alternatives and similar repositories for CXX-DeepLearning-Inference
Users that are interested in CXX-DeepLearning-Inference are comparing it to the libraries listed below
Sorting:
- segmentation algorithm yolact use tensorrt deploy☆14Updated 3 years ago
- yolov8obb 旋转目标检测部署rknn的C++代码☆17Updated 10 months ago
- C++ TensorRT Implementation of NanoSAM☆36Updated last year
- RT-DETRv2 tensorrt C++ 部署☆17Updated 7 months ago
- FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。☆18Updated last year
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆12Updated last year
- pose estimation code with deepstream and yolo-pose☆13Updated 2 years ago
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆12Updated last week
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆26Updated 11 months ago
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆14Updated last year
- ☆15Updated last year
- An onnx-based quantitation tool.☆71Updated last year
- yolov8seg 瑞芯微 rknn 板端 C++部署，使用平台 rk3588。☆24Updated last year
- 分别使用OpenCV、ONNXRuntime部署CenterNet目标检测，包含C++和Python两个版本的程序☆9Updated 2 years ago
- 用OpenVINO对yolov8导出的onnx模型进行C++的推理, 任务包括图像分类, 目标识别和语义分割, 步骤包括图片前处理, 推理, NMS等☆64Updated last year
- Speed up image preprocess with cuda when handle image or tensorrt inference☆68Updated 3 weeks ago
- yolov11 的tensorRT C++ 部署，后处理使用cuda实现比较耗时的操作。☆35Updated 5 months ago
- learn TensorRT from scratch🥰☆15Updated 8 months ago
- ☆19Updated 2 years ago
- NanoTrack(@HonglinChu), C++ TensorRT deployment. MAX 250 FPS!☆24Updated last year
- 跟着Tensorrt_pro学习各种知识☆39Updated 2 years ago
- 高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀☆49Updated 2 years ago
- This project provides simple code and demonstrates how to use the TensorRT C++ API and ONNX to deploy PaddleOCR text recognition model.☆44Updated 2 years ago
- ☆44Updated 2 years ago
- yolov11（yolov8）尝试了7种不同的部署方法，并对每种方法的优势进行了简单总结。不同的平台、不同的时耗或CPU占用需求，总有一种方法是适用的。针对想入门部署的也是一个很好的参考学习资料。☆24Updated 4 months ago
- a simple lightweight large language model pipeline framework.☆25Updated last month
- yolov8n 部署版，基于官方的导出onnx脚本导出onnx模型，在不同平台上进行部署测试，便于移植不同平台（onnx、tensorRT、rknn、Horizon）。☆38Updated 2 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆11Updated 2 months ago
- This is a repository to practice multi-thread programming in C++☆24Updated last year
- Llama3 Streaming Chat Sample☆22Updated last year