shouxieai/infer external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

shouxieai/infer

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/shouxieai/infer)

Close

shouxieai / inferView on GitHubMore

• External links
• Readme badge

A new tensorrt integrate. Easy to integrate many tasks

☆455Apr 2, 2023Updated 3 years ago

Alternatives and similar repositories for infer

Users that are interested in infer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• 1461521844lijin / trt_yolo_video_pipeline

  View on GitHub
  TensorRT+YOLO系列的 多路 多卡 多实例 并行视频分析处理案例
  ☆333Feb 10, 2025Updated last year
• shouxieai / tensorRT_Pro

  View on GitHub
  C++ library based on tensorrt integration
  ☆2,894May 24, 2023Updated 3 years ago
• shouxieai / nerf

  View on GitHub
  nerf
  ☆41Aug 1, 2022Updated 4 years ago
• yhwang-hub / dl_model_deploy

  View on GitHub
  ☆79May 16, 2023Updated 3 years ago
• Guanbin-Huang / tensorRT_Pro_co-comments

  View on GitHub
  ☆119Aug 13, 2023Updated 3 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• yhwang-hub / dl_model_infer

  View on GitHub
  🚀🚀🚀This is an AI high-performance reasoning C++ library, Currently supports the deployment of yolov5, yolov7, yolov7-pose, yolov8, yol…
  ☆137May 4, 2024Updated 2 years ago
• Melody-Zhou / tensorRT_Pro-Vision

  View on GitHub
  This repository is forked from shouxieai/tensorRT_Pro, extending it to support a wide range of vision models with high-performance Tensor…
  ☆412Jun 26, 2026Updated 2 months ago
• shouxieai / hard_decode_trt

  View on GitHub
  Yolov5 inference on NVDec hardware decoder
  ☆91Nov 6, 2021Updated 4 years ago
• BaofengZan / my_trt_pro

  View on GitHub
  跟着Tensorrt_pro学习各种知识
  ☆39Nov 25, 2022Updated 3 years ago
• FeiYull / TensorRT-Alpha

  View on GitHub
  🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
  ☆1,460Jul 19, 2024Updated 2 years ago
• NVIDIA-AI-IOT / yolo_deepstream

  View on GitHub
  yolo model qat and deploy with deepstream&tensorrt
  ☆607Sep 25, 2024Updated last year
• sesmfs / onnx_matcher

  View on GitHub
  Using pattern matcher in onnx model to match and replace subgraphs.
  ☆81Feb 7, 2024Updated 2 years ago
• CYYAI / AiInfer

  View on GitHub
  ☆114Mar 11, 2024Updated 2 years ago
• sesmfs / 360-Surround-View-CUDA-Project

  View on GitHub
  10000 fps 🚀 for 360 Surround-View CUDA Solution
  ☆151Dec 23, 2023Updated 2 years ago
• Deploy to Railway using AI coding agents - Free Credits Offer • Ad
  Use Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
• shouxieai / tensorRT_quantization

  View on GitHub
  该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。
  ☆69Oct 7, 2023Updated 2 years ago
• sesmfs / onnx_quant_tool

  View on GitHub
  An onnx-based quantitation tool.
  ☆71Jan 8, 2024Updated 2 years ago
• wangzyon / pyInfer

  View on GitHub
  async inference for machine learning model
  ☆26Sep 21, 2022Updated 3 years ago
• raymond1123 / Flash-Attention

  View on GitHub
  ☆26Nov 21, 2024Updated last year
• alexw914 / RK_VideoPipe

  View on GitHub
  ☆123Aug 1, 2024Updated 2 years ago
• NVIDIA-AI-IOT / cuDLA-samples

  View on GitHub
  YOLOv5 on Orin DLA
  ☆228Feb 18, 2024Updated 2 years ago
• wang-xinyu / tensorrtx

  View on GitHub
  Implementation of popular deep learning networks with TensorRT network definition API
  ☆7,833Aug 18, 2026Updated 3 weeks ago
• shouxieai / A-series-of-CV

  View on GitHub
  ☆56Aug 21, 2023Updated 3 years ago
• NVIDIA-AI-IOT / tensorrt_plugin_generator

  View on GitHub
  A simple tool that can generate TensorRT plugin code quickly.
  ☆243Jul 11, 2023Updated 3 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• shouxieai / learning-cuda-trt

  View on GitHub
  learning-cuda-trt
  ☆123Feb 23, 2023Updated 3 years ago
• NVIDIA-AI-IOT / Lidar_AI_Solution

  View on GitHub
  A project demonstrating Lidar related AI solutions, including three GPU accelerated Lidar/camera DL networks (PointPillars, CenterPoint, …
  ☆1,877Jul 28, 2026Updated last month
• triple-mu / YOLOv8-TensorRT

  View on GitHub
  YOLOv8 using TensorRT accelerate !
  ☆1,807Aug 14, 2026Updated 3 weeks ago
• Li-Hongda / TensorRT_Inference_Demo

  View on GitHub
  A repo that uses TensorRT to deploy wll-trained models.Support RTDETR,YOLO-NAS,YOLOV5,YOLOV6,YOLOV7,YOLOV8,YOLOX.
  ☆107Jul 21, 2023Updated 3 years ago
• BaofengZan / hard_decode_trt-windows

  View on GitHub
  https://github.com/shouxieai/hard_decode_trt windows编译版本
  ☆13Sep 8, 2022Updated 4 years ago
• shouxieai / kiwi-rknn

  View on GitHub
  rknn inference
  ☆47Mar 7, 2022Updated 4 years ago
• Linaom1214 / TensorRT-For-YOLO-Series

  View on GitHub
  tensorrt for yolo series (YOLOv11,YOLOv10,YOLOv9,YOLOv8,YOLOv7,YOLOv6,YOLOX,YOLOv5), nms plugin support
  ☆1,161Oct 15, 2025Updated 10 months ago
• nndeploy / nndeploy

  View on GitHub
  一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework
  ☆1,876Aug 15, 2026Updated 3 weeks ago
• hopef / llama3_chat

  View on GitHub
  Llama3 Streaming Chat Sample
  ☆22Apr 24, 2024Updated 2 years ago
• Wordpress hosting with auto-scaling - Free Trial Offer • Ad
  Fully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
• cvdong / YOLO_TRT_SIM

  View on GitHub
  高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀
  ☆54Feb 23, 2023Updated 3 years ago
• GalinaRejoice / learning-cuda-trt

  View on GitHub
  ☆12Jan 25, 2023Updated 3 years ago
• raymond1123 / hgemm

  View on GitHub
  ☆30Nov 16, 2024Updated last year
• shouxieai / algorithm-cpp

  View on GitHub
  algorithm-cpp projects
  ☆81Sep 25, 2022Updated 3 years ago
• jizhishutong / YOLOU

  View on GitHub
  YOLOv3、YOLOv4、YOLOv5、YOLOv5-Lite、YOLOv6-v1、YOLOv6-v2、YOLOv7、YOLOX、YOLOX-Lite、PP-YOLOE、PP-PicoDet-Plus、YOLO-Fastest v2、FastestDet、YOLOv5-S…
  ☆767Oct 25, 2022Updated 3 years ago
• cvdong / TRT_PRO_LEARN

  View on GitHub
  对 tensorRT_Pro 开源项目理解
  ☆22Feb 23, 2023Updated 3 years ago
• richjjj / cuvid-tensorrt-multi

  View on GitHub
  ffmpeg+cuvid+tensorrt+multicamera
  ☆12Dec 31, 2024Updated last year