yhwang-hub/dl_model_infer external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

yhwang-hub/dl_model_infer

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/yhwang-hub/dl_model_infer)

Close

yhwang-hub / dl_model_inferView on GitHubMore

• External links
• Readme badge

🚀🚀🚀This is an AI high-performance reasoning C++ library, Currently supports the deployment of yolov5, yolov7, yolov7-pose, yolov8, yolov8-seg, yolov8-pose, yolov8-obb, yolox, RTDETR, DETR, depth-anything, yolop, yolopv2, SMOKE, yolov9 and other models.🚀🚀🚀

☆137May 4, 2024Updated 2 years ago

Alternatives and similar repositories for dl_model_infer

Users that are interested in dl_model_infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• yhwang-hub / dl_model_deploy

  View on GitHub
  ☆79May 16, 2023Updated 3 years ago
• CYYAI / AiInfer

  View on GitHub
  ☆114Mar 11, 2024Updated 2 years ago
• BaofengZan / my_trt_pro

  View on GitHub
  跟着Tensorrt_pro学习各种知识
  ☆39Nov 25, 2022Updated 3 years ago
• yhwang-hub / yolov7_QAT

  View on GitHub
  Quantize yolov7 using pytorch_quantization.🚀🚀🚀
  ☆12Oct 20, 2023Updated 3 years ago
• leon0514 / cuda-sahi-crop-image

  View on GitHub
  使用cuda实现类似sahi库的切图
  ☆13Jul 21, 2026Updated 3 months ago
• Managed hosting for WordPress and PHP on Cloudways • Ad
  Managed hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
• 1461521844lijin / trt_yolo_video_pipeline

  View on GitHub
  TensorRT+YOLO系列的 多路 多卡 多实例 并行视频分析处理案例
  ☆337Feb 10, 2025Updated last year
• raymond1123 / hgemm

  View on GitHub
  ☆30Nov 16, 2024Updated last year
• Melody-Zhou / tensorRT_Pro-Vision

  View on GitHub
  This repository is forked from shouxieai/tensorRT_Pro, extending it to support a wide range of vision models with high-performance Tensor…
  ☆415Updated this week
• shouxieai / kiwi-rknn

  View on GitHub
  rknn inference
  ☆47Mar 7, 2022Updated 4 years ago
• sesmfs / onnx_quant_tool

  View on GitHub
  An onnx-based quantitation tool.
  ☆71Jan 8, 2024Updated 2 years ago
• shouxieai / infer

  View on GitHub
  A new tensorrt integrate. Easy to integrate many tasks
  ☆455Apr 2, 2023Updated 3 years ago
• cvdong / YOLO_TRT_SIM

  View on GitHub
  高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀
  ☆54Feb 23, 2023Updated 3 years ago
• wangzyon / pyInfer

  View on GitHub
  async inference for machine learning model
  ☆26Sep 21, 2022Updated 4 years ago
• l-sf / Linfer

  View on GitHub
  基于TensorRT的C++高性能推理库，Yolov10, YoloPv2，Yolov5/7/X/8，RT-DETR，单目标跟踪OSTrack、LightTrack。
  ☆237Jun 12, 2024Updated 2 years ago
• Serverless GPU API endpoints on Runpod - Get Bonus Credits • Ad
  Skip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
• shouxieai / hard_decode_trt

  View on GitHub
  Yolov5 inference on NVDec hardware decoder
  ☆91Nov 6, 2021Updated 4 years ago
• Zhou-wy / TRT-YOLOv8-Seg

  View on GitHub
  使用TensorRT加速YOLOv8-Seg，完整的后端框架，包括Http服务器，Mysql数据库，ffmpeg视频推流等。
  ☆90Oct 9, 2023Updated 3 years ago
• zjd1988 / video_pipe_c

  View on GitHub
  a plugin-oriented framework for video structured. 国产程序员请加微信zhzhi78拉群交流。
  ☆18May 28, 2024Updated 2 years ago
• shouxieai / tensorRT_quantization

  View on GitHub
  该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。
  ☆70Oct 7, 2023Updated 3 years ago
• sherlockchou86 / PyLangPipe

  View on GitHub
  a simple lightweight large language model pipeline framework.
  ☆27Apr 25, 2025Updated last year
• sesmfs / 360-Surround-View-CUDA-Project

  View on GitHub
  10000 fps 🚀 for 360 Surround-View CUDA Solution
  ☆151Dec 23, 2023Updated 2 years ago
• shouxieai / nerf

  View on GitHub
  nerf
  ☆41Aug 1, 2022Updated 4 years ago
• shalvenlaw / OpenVINO_yolov8

  View on GitHub
  用OpenVINO对yolov8导出的onnx模型进行C++的推理, 任务包括图像分类, 目标识别和语义分割, 步骤包括图片前处理, 推理, NMS等
  ☆77Apr 28, 2024Updated 2 years ago
• sesmfs / onnx_matcher

  View on GitHub
  Using pattern matcher in onnx model to match and replace subgraphs.
  ☆81Feb 7, 2024Updated 2 years ago
• Proton VPN Special Offer - Get 70% off • Ad
  Special partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
• alexw914 / RK_VideoPipe

  View on GitHub
  ☆123Aug 1, 2024Updated 2 years ago
• zjd1988 / rknn_backend

  View on GitHub
  ☆19Jan 19, 2024Updated 2 years ago
• NVIDIA-AI-IOT / yolo_deepstream

  View on GitHub
  yolo model qat and deploy with deepstream&tensorrt
  ☆610Sep 25, 2024Updated 2 years ago
• richjjj / duscratch

  View on GitHub
  搜藏的希望的代码片段
  ☆13Jun 6, 2023Updated 3 years ago
• cqu20160901 / RT-DETRv2_TensorRT_Cplusplus

  View on GitHub
  RT-DETRv2 tensorrt C++ 部署
  ☆26Oct 29, 2024Updated last year
• BaofengZan / hard_decode_trt-windows

  View on GitHub
  https://github.com/shouxieai/hard_decode_trt windows编译版本
  ☆13Sep 8, 2022Updated 4 years ago
• cqu20160901 / FastSAM_onnx_rknn

  View on GitHub
  FastSAM 部署版本，便于移植不同平，部署简单、运行速度快。
  ☆26May 30, 2024Updated 2 years ago
• FeiYull / TensorRT-Alpha

  View on GitHub
  🔥🔥🔥TensorRT for YOLO26 (det/pose/seg/depth/obb/cls), YOLOv11,YOLOv10 YOLOv9,YOLOv8, ... 🚀🚀🚀 CUDA IS ALL YOU NEED. 🍎🍎🍎
  ☆1,464Updated this week
• yhwang-hub / yolov5_QAT

  View on GitHub
  Quantize yolov5 using pytorch_quantization.🚀🚀🚀
  ☆15Oct 24, 2023Updated 3 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• liwuhen / CVDeploy-2D

  View on GitHub
  The repository supports TensorRT, QNN platform inference, 2D obstacle detection yolo series (yolov5, yolov8, yolo11, yolox), semantic seg…
  ☆20May 6, 2025Updated last year
• mailliw2010 / infer-frame

  View on GitHub
  a ai infra framework for edge device base on nndeploy
  ☆17Nov 27, 2025Updated 10 months ago
• leon0514 / trt-sam3

  View on GitHub
  Using C++ TensorRT for SAM3 model inference
  ☆121Jul 1, 2026Updated 3 months ago
• laugh12321 / TensorRT-YOLO

  View on GitHub
  🚀 Easier & Faster YOLO Deployment Toolkit for NVIDIA 🛠️
  ☆1,894Sep 10, 2026Updated last month
• xjhaz / yolov8_obb_ChipPinDefectDetection

  View on GitHub
  基于yolov8_obb的芯片引脚缺陷检测，使用tensorrt进行加速。
  ☆22Aug 2, 2024Updated 2 years ago
• cvdong / TRT_PRO_LEARN

  View on GitHub
  对 tensorRT_Pro 开源项目理解
  ☆22Feb 23, 2023Updated 3 years ago
• shouxieai / lover

  View on GitHub
  520, lover
  ☆10May 15, 2023Updated 3 years ago