A unified and extensible pipeline for deep learning model inference with C++. Now support yolov8, yolov9, clip, and nanosam. More models will be updated soon.
☆12Aug 3, 2025Updated 10 months ago
Alternatives and similar repositories for CXX-DeepLearning-Inference
Users that are interested in CXX-DeepLearning-Inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- C++ TensorRT Implementation of NanoSAM☆51Dec 28, 2023Updated 2 years ago
- yolov5_obb C++ onnxruntime deployment☆10Mar 11, 2024Updated 2 years ago
- RT-DETRv2 tensorrt C++ 部署☆26Oct 29, 2024Updated last year
- 使用ONNXRuntime部署Informative-Drawings生成素描画，包含C++和Python两个版本的程序☆14Sep 7, 2023Updated 2 years ago
- yolov8在hisi3536a推理☆11Dec 15, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Simple and efficient memory pool is implemented with C++11.☆10Jun 2, 2022Updated 4 years ago
- Quickly inference EdgeSAM with MNN☆14Dec 19, 2023Updated 2 years ago
- Repository to implement the YOLO-Behaviour framework☆25Aug 18, 2025Updated 9 months ago
- This repo provides the C++ implementation of YOLO-NAS based on ONNXRuntime for performing object detection in real-time.Support float32/f…☆46Apr 1, 2024Updated 2 years ago
- ☆12Jan 22, 2024Updated 2 years ago
- ☆43Oct 8, 2024Updated last year
- TensorRT for YOLOv10 with CUDA☆12Jan 24, 2025Updated last year
- Speed up image preprocess with cuda when handle image or tensorrt inference☆85Nov 5, 2025Updated 7 months ago
- RK3588 Debian11环境下实现yolov5-face的推理实现，包括Python和C++实现。主要依赖RKNPU2 SDK和rknn_toolkit_lite2☆27Jun 3, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Neural radiance fields(NeRF) c++ LibTorch implementation☆17Dec 30, 2025Updated 5 months ago
- ☆19Apr 28, 2023Updated 3 years ago
- A ready-to-use notebook!☆60Oct 24, 2025Updated 7 months ago
- A tutorial introducing knowledge distillation as an optimization technique for deployment on NVIDIA Jetson☆242Nov 14, 2023Updated 2 years ago
- This software allows to run MobileSAM (Image Segmentation model), without python.☆25Jun 23, 2024Updated last year
- TensorFlowLiteNet allows to use TensorFlowLite from C#.☆11Apr 14, 2021Updated 5 years ago
- The C++ Implementation of XFeat (Accelerated Features).☆82Aug 14, 2024Updated last year
- ☆44Aug 13, 2024Updated last year
- openFrameworks implementation of whisper.cpp☆13Sep 14, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆28Feb 18, 2026Updated 3 months ago
- Deploy RT-EDTR with onnx from paddlepaddle framwork and graph cut☆32May 5, 2023Updated 3 years ago
- Convert the data from stanford drone dataset to kitti format☆11Nov 20, 2017Updated 8 years ago
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- TensorRT Engine for SAM-3 model by Meta AI☆163Mar 2, 2026Updated 3 months ago
- 使用TensorRT进行sam2分割☆22Oct 31, 2024Updated last year
- Try to export the ONNX QDQ model that conforms to the AXERA NPU quantization specification. Currently, only w8a8 is supported.☆11Sep 10, 2024Updated last year
- An implement of ORB-SLAM3 with python.☆10Jul 2, 2023Updated 2 years ago
- Created a simple neural network using C++17 standard and the Eigen library that supports both forward and backward propagation.☆11Jul 27, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- C++ implementations of YOLOv8/YOLO26, RT-DETR-V2(RTDETR), MobileSAM, and NanoSAM on TensorRT, ONNX Runtime, and RKNN.☆56Jan 16, 2026Updated 4 months ago
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆15May 6, 2023Updated 3 years ago
- langgraph的deepagent源码分析☆18Jan 1, 2026Updated 5 months ago
- project page of "VAD v2: LLM-Like Probabilistic Modeling in End-to-End Autonomous Driving"☆11Apr 9, 2026Updated 2 months ago
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆11Jan 9, 2024Updated 2 years ago
- 在ROS环境下进行机器人建图导航(Cartographer+Movebase)、目标检测（Nanodet)、语音播报和语音导航任务发布(Sherpa_onnx)。☆16Apr 28, 2025Updated last year
- 记录论文实验过程中完整的思路发展，以及一路遇到的问题及解决方案。Linux下C++开发。☆11Sep 21, 2024Updated last year