A unified and extensible pipeline for deep learning model inference with C++. Now support yolov8, yolov9, clip, and nanosam. More models will be updated soon.
☆12Aug 3, 2025Updated 7 months ago
Alternatives and similar repositories for CXX-DeepLearning-Inference
Users that are interested in CXX-DeepLearning-Inference are comparing it to the libraries listed below
Sorting:
- C++ TensorRT Implementation of NanoSAM☆49Dec 28, 2023Updated 2 years ago
- yolov5_obb C++ onnxruntime deployment☆10Mar 11, 2024Updated 2 years ago
- RT-DETRv2 tensorrt C++ 部署☆23Oct 29, 2024Updated last year
- 使用ONNXRuntime部署Informative-Drawings生成素描画，包含C++和Python两个版本的程序☆14Sep 7, 2023Updated 2 years ago
- yolov8在hisi3536a推理☆11Dec 15, 2023Updated 2 years ago
- Simple and efficient memory pool is implemented with C++11.☆10Jun 2, 2022Updated 3 years ago
- Repository to implement the YOLO-Behaviour framework☆21Aug 18, 2025Updated 7 months ago
- Quickly inference EdgeSAM with MNN☆14Dec 19, 2023Updated 2 years ago
- This repo provides the C++ implementation of YOLO-NAS based on ONNXRuntime for performing object detection in real-time.Support float32/f…☆45Apr 1, 2024Updated last year
- ☆12Jan 22, 2024Updated 2 years ago
- ☆40Oct 8, 2024Updated last year
- TensorRT for YOLOv10 with CUDA☆13Jan 24, 2025Updated last year
- Speed up image preprocess with cuda when handle image or tensorrt inference☆84Nov 5, 2025Updated 4 months ago
- RK3588 Debian11环境下实现yolov5-face的推理实现，包括Python和C++实现。主要依赖RKNPU2 SDK和rknn_toolkit_lite2☆25Jun 3, 2024Updated last year
- Neural radiance fields(NeRF) c++ LibTorch implementation☆17Dec 30, 2025Updated 2 months ago
- A ready-to-use notebook!☆60Oct 24, 2025Updated 4 months ago
- ☆19Apr 28, 2023Updated 2 years ago
- TensorRT Engine for SAM-3 model by Meta AI☆80Mar 2, 2026Updated 2 weeks ago
- A tutorial introducing knowledge distillation as an optimization technique for deployment on NVIDIA Jetson☆235Nov 14, 2023Updated 2 years ago
- This software allows to run MobileSAM (Image Segmentation model), without python.☆25Jun 23, 2024Updated last year
- TensorFlowLiteNet allows to use TensorFlowLite from C#.☆11Apr 14, 2021Updated 4 years ago
- ☆40Aug 13, 2024Updated last year
- The C++ Implementation of XFeat (Accelerated Features).☆79Aug 14, 2024Updated last year
- openFrameworks implementation of whisper.cpp☆13Sep 14, 2023Updated 2 years ago
- Deploy RT-EDTR with onnx from paddlepaddle framwork and graph cut☆31May 5, 2023Updated 2 years ago
- Convert the data from stanford drone dataset to kitti format☆11Nov 20, 2017Updated 8 years ago
- Converts CLIP models to ONNX☆10Jan 17, 2023Updated 3 years ago
- Try to export the ONNX QDQ model that conforms to the AXERA NPU quantization specification. Currently, only w8a8 is supported.☆10Sep 10, 2024Updated last year
- 使用TensorRT进行sam2分割☆22Oct 31, 2024Updated last year
- An implement of ORB-SLAM3 with python.☆10Jul 2, 2023Updated 2 years ago
- C++ implementations of YOLOv8/YOLO26, RT-DETR-V2(RTDETR), MobileSAM, and NanoSAM on TensorRT, ONNX Runtime, and RKNN.☆53Jan 16, 2026Updated 2 months ago
- Created a simple neural network using C++17 standard and the Eigen library that supports both forward and backward propagation.☆10Jul 27, 2024Updated last year
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆14May 6, 2023Updated 2 years ago
- langgraph的deepagent源码分析☆14Jan 1, 2026Updated 2 months ago
- project page of "VAD v2: LLM-Like Probabilistic Modeling in End-to-End Autonomous Driving"☆11Mar 8, 2024Updated 2 years ago
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆10Jan 9, 2024Updated 2 years ago
- 记录论文实验过程中完整的思路发展，以及一路遇到的问题及解决方案。Linux下C++开发。☆11Sep 21, 2024Updated last year
- 在ROS环境下进行 机器人建图导航(Cartographer+Movebase)、目标检测（Nanodet)、语音播报和语音导航任务发布(Sherpa_onnx)。☆16Apr 28, 2025Updated 10 months ago
- 完全可理解的VINS-Fusion：1.全量靠谱注释、2.代码风格轻重构、3.代码即文档、4.忠实于原代码；5.ROS解耦、6.状态量可视化、7.日志系统。☆10Dec 27, 2023Updated 2 years ago