A unified and extensible pipeline for deep learning model inference with C++. Now support yolov8, yolov9, clip, and nanosam. More models will be updated soon.
☆12Aug 3, 2025Updated 11 months ago
Alternatives and similar repositories for CXX-DeepLearning-Inference
Users that are interested in CXX-DeepLearning-Inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- C++ TensorRT Implementation of NanoSAM☆53Dec 28, 2023Updated 2 years ago
- yolov5_obb C++ onnxruntime deployment☆10Mar 11, 2024Updated 2 years ago
- 使用ONNXRuntime部署Informative-Drawings生成素描画，包含C++和Python两个版本的程序☆14Sep 7, 2023Updated 2 years ago
- RT-DETRv2 tensorrt C++ 部署☆26Oct 29, 2024Updated last year
- yolov8在hisi3536a推理☆11Dec 15, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Simple and efficient memory pool is implemented with C++11.☆10Jun 2, 2022Updated 4 years ago
- Quickly inference EdgeSAM with MNN☆15Dec 19, 2023Updated 2 years ago
- This repo provides the C++ implementation of YOLO-NAS based on ONNXRuntime for performing object detection in real-time.Support float32/f…☆46Apr 1, 2024Updated 2 years ago
- 基于YOLOv8的小目标检测算法，部署在华为晟腾开发板（Atlas 200I DK A2）。☆16Apr 27, 2025Updated last year
- ☆12Jan 22, 2024Updated 2 years ago
- ☆42Oct 8, 2024Updated last year
- TensorRT for YOLOv10 with CUDA☆12Jan 24, 2025Updated last year
- Speed up image preprocess with cuda when handle image or tensorrt inference☆85Nov 5, 2025Updated 8 months ago
- RK3588 Debian11环境下实现yolov5-face的推理实现，包括Python和C++实现。主要依赖RKNPU2 SDK和rknn_toolkit_lite2☆27Jun 3, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A ready-to-use notebook!☆60Jul 10, 2026Updated last week
- Neural radiance fields(NeRF) c++ LibTorch implementation☆17Dec 30, 2025Updated 6 months ago
- A tutorial introducing knowledge distillation as an optimization technique for deployment on NVIDIA Jetson☆244Nov 14, 2023Updated 2 years ago
- TensorFlowLiteNet allows to use TensorFlowLite from C#.☆11Apr 14, 2021Updated 5 years ago
- Repository to implement the YOLO-Behaviour framework☆27Aug 18, 2025Updated 11 months ago
- ☆19Apr 28, 2023Updated 3 years ago
- Deploy RT-EDTR with onnx from paddlepaddle framwork and graph cut☆32May 5, 2023Updated 3 years ago
- openFrameworks implementation of whisper.cpp☆13Sep 14, 2023Updated 2 years ago
- This software allows to run MobileSAM (Image Segmentation model), without python.☆25Jun 23, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Convert the data from stanford drone dataset to kitti format☆11Nov 20, 2017Updated 8 years ago
- Converts CLIP models to ONNX☆11Jan 17, 2023Updated 3 years ago
- An implement of ORB-SLAM3 with python.☆10Jul 2, 2023Updated 3 years ago
- project page of "VAD v2: LLM-Like Probabilistic Modeling in End-to-End Autonomous Driving"☆11Apr 9, 2026Updated 3 months ago
- LDC: Lightweight Dense CNN for Edge DetectionのPythonでのONNX推論サンプル☆15May 6, 2023Updated 3 years ago
- [DEIMv2] Real Time Object Detection Meets DINOv3 C++ and ONNX version☆33Dec 31, 2025Updated 6 months ago
- Created a simple neural network using C++17 standard and the Eigen library that supports both forward and backward propagation.☆11Jul 27, 2024Updated last year
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆12Jan 9, 2024Updated 2 years ago
- 完全可理解的VINS-Fusion：1.全量靠谱注释、2.代码风格轻重构、3.代码即文档、4.忠实于原代码；5.ROS解耦、6.状态量可视化、7.日志系统。☆10Dec 27, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- yolov8seg 部署版本，便于移植不同平台（onnx、tensorRT、rknn、Horizon），全网部署最简单、速度最快的部署方式。☆11May 20, 2024Updated 2 years ago
- ☆11Jun 17, 2025Updated last year
- Try to export the ONNX QDQ model that conforms to the AXERA NPU quantization specification. Currently, only w8a8 is supported.☆11Sep 10, 2024Updated last year
- 使用TensorRT进行sam2分割☆23Oct 31, 2024Updated last year
- Bongo cat in python! Good for streaming.☆11Jun 6, 2025Updated last year
- ☆12May 16, 2024Updated 2 years ago
- 使用OpenCV部署图像描述Image_Captioning，包含C++和Python两个版本的程序☆12Dec 22, 2023Updated 2 years ago