Huntersdeng / CXX-DeepLearning-InferenceLinks
A unified and extensible pipeline for deep learning model inference with C++. Now support yolov8, yolov9, clip, and nanosam. More models will be updated soon.
☆12Updated last month
Alternatives and similar repositories for CXX-DeepLearning-Inference
Users that are interested in CXX-DeepLearning-Inference are comparing it to the libraries listed below
Sorting:
- RT-DETRv2 tensorrt C++ 部署☆21Updated 10 months ago
- FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。☆23Updated last year
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆28Updated last year
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解 决转tensorrt 输出全为0问题的新方法。☆12Updated last year
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆14Updated last year
- yolov8obb 旋转目标检测部署rknn的C++代码☆18Updated last year
- 用OpenVINO对yolov8导出的onnx模型进行C++的推理, 任务包括图像分类, 目标识别和语义分割, 步骤包括图片前处理, 推理, NMS等☆71Updated last year
- Speed up image preprocess with cuda when handle image or tensorrt inference☆77Updated last month
- 高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀☆50Updated 2 years ago
- An onnx-based quantitation tool.☆71Updated last year
- C++ TensorRT Implementation of NanoSAM☆43Updated last year
- yolov8seg 瑞芯微 rknn 板端 C++部署，使用平台 rk3588。☆26Updated last year
- This project provides simple code and demonstrates how to use the TensorRT C++ API and ONNX to deploy PaddleOCR text recognition model.☆48Updated 3 years ago
- 跟着Tensorrt_pro学习各种知识☆40Updated 2 years ago
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆13Updated last month
- YOLOv9 Tensorrt deployment acceleration，provide two implementation methods: C++and Python🔥🔥🔥☆32Updated last year
- ☆47Updated 2 years ago
- yolov10 目标检测部署版本，便于移植不同平台（onnx、tensorRT、rknn、Horizon），全网部署最简单、运行速度最快的部署方式（全网首发）。☆53Updated last year
- A Python and C++ library for model encryption and decryption, built on Crypto++, with support for various deep learning frameworks includ…☆48Updated last year
- 使用ONNXRuntime部署面向轻量实时的M-LSD直线检测，包含C++和Python两个版本的程序☆26Updated 2 years ago
- 🚀🚀🚀This is an AI high-performance reasoning C++ library, Currently supports the deployment of yolov5, yolov7, yolov7-pose, yolov8, yol…☆133Updated last year
- 在Jetson AGX Xavier上部署yolov8-seg检测分割模型（带自适应低光照补偿）☆50Updated 6 months ago
- "FastSAM_Awsome_Openvino" 项目展示了如何通过 OpenVINO 框架高效部署 FastSAM 模型，实现了令人瞩目的实例分割功能。该项目提供了 C++ 版本和 Python 版本两种实现，为开发者提供了在不同语言环境下使用 FastSAM 模型的选…☆35Updated last year
- 使用TensorRT加速YOLOv8-Seg，完整的后端框架，包括Http服务器，Mysql数据库，ffmpeg视频推流等。☆85Updated last year
- a simple lightweight large language model pipeline framework.☆27Updated 4 months ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Updated 6 months ago
- NanoTrack(@HonglinChu), C++ TensorRT deployment. MAX 250 FPS!☆27Updated last year
- YOLOv8 C++ DET、SEG 、POSE TENSORRT 推理库，便于学习开发拓展与工作中实际部署☆18Updated 2 years ago
- tensorrt sahi yolo 目标检测☆70Updated 2 weeks ago
- C++ implementations of YOLOv8, RT-DETR-V2(RTDETR), MobileSAM, and NanoSAM on TensorRT, ONNX Runtime, and RKNN.☆36Updated 2 months ago