🚀🚀🚀This is an AI high-performance reasoning C++ library, Currently supports the deployment of yolov5, yolov7, yolov7-pose, yolov8, yolov8-seg, yolov8-pose, yolov8-obb, yolox, RTDETR, DETR, depth-anything, yolop, yolopv2, SMOKE, yolov9 and other models.🚀🚀🚀
☆136May 4, 2024Updated last year
Alternatives and similar repositories for dl_model_infer
Users that are interested in dl_model_infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆79May 16, 2023Updated 2 years ago
- Quantize yolov7 using pytorch_quantization.🚀🚀🚀☆12Oct 20, 2023Updated 2 years ago
- ☆114Mar 11, 2024Updated 2 years ago
- TensorRT+YOLO系列的 多路 多卡 多实例 并行视频分析处理案例☆327Feb 10, 2025Updated last year
- This repository is based on shouxieai/tensorRT_Pro, with adjustments to support YOLOv8.☆408Jan 15, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 跟着Tensorrt_pro学习各种知识☆39Nov 25, 2022Updated 3 years ago
- ☆30Nov 16, 2024Updated last year
- A new tensorrt integrate. Easy to integrate many tasks☆454Apr 2, 2023Updated 3 years ago
- rknn inference☆48Mar 7, 2022Updated 4 years ago
- async inference for machine learning model☆26Sep 21, 2022Updated 3 years ago
- 高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀☆54Feb 23, 2023Updated 3 years ago
- An onnx-based quantitation tool.☆71Jan 8, 2024Updated 2 years ago
- Yolov5 inference on NVDec hardware decoder☆91Nov 6, 2021Updated 4 years ago
- 基于TensorRT的C++高性能推理库，Yolov10, YoloPv2，Yolov5/7/X/8，RT-DETR，单目标跟踪OSTrack、LightTrack。☆229Jun 12, 2024Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- nerf☆41Aug 1, 2022Updated 3 years ago
- 使用TensorRT加速YOLOv8-Seg，完整的后端框架，包括Http服务器，Mysql数据库，ffmpeg视频推流等。☆89Oct 9, 2023Updated 2 years ago
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆70Oct 7, 2023Updated 2 years ago
- a plugin-oriented framework for video structured. 国产程序员请加微信zhzhi78拉群交流。☆18May 28, 2024Updated last year
- a simple lightweight large language model pipeline framework.☆28Apr 25, 2025Updated last year
- https://github.com/shouxieai/hard_decode_trt windows编译版本☆13Sep 8, 2022Updated 3 years ago
- Using pattern matcher in onnx model to match and replace subgraphs.☆81Feb 7, 2024Updated 2 years ago
- ☆120Aug 1, 2024Updated last year
- 10000 fps 🚀 for 360 Surround-View CUDA Solution☆150Dec 23, 2023Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 用OpenVINO对yolov8导出的onnx模型进行C++的推理, 任务包括图像分类, 目标识别和语义分割, 步骤包括图片前处理, 推理, NMS等☆76Apr 28, 2024Updated 2 years ago
- yolo model qat and deploy with deepstream&tensorrt☆602Sep 25, 2024Updated last year
- A Python and C++ library for model encryption and decryption, built on Crypto++, with support for various deep learning frameworks includ…☆51Oct 27, 2023Updated 2 years ago
- 对 tensorRT_Pro 开源项目理解☆22Feb 23, 2023Updated 3 years ago
- 🚀 Easier & Faster YOLO Deployment Toolkit for NVIDIA 🛠️☆1,787Mar 22, 2026Updated last month
- ☆19Jan 19, 2024Updated 2 years ago
- 一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework☆1,796Updated this week
- 🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎☆1,430Jul 19, 2024Updated last year
- FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。☆25May 30, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 2 years ago
- 3d object detection model smoke c++ inference code☆39Dec 1, 2022Updated 3 years ago
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 2 years ago
- YoloV8 segmentation NPU for the RK 3566/68/88☆18Apr 30, 2024Updated last year
- yolov7目标检测算法的c++ tensorrt部署代码☆31Jul 19, 2022Updated 3 years ago
- C++ library based on tensorrt integration☆2,875May 24, 2023Updated 2 years ago
- Quantize yolov5 using pytorch_quantization.🚀🚀🚀☆15Oct 24, 2023Updated 2 years ago