wangzyon/pyInfer external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

wangzyon/pyInfer

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/wangzyon/pyInfer)

Close

wangzyon / pyInferView on GitHubMore

• External links
• Readme badge

async inference for machine learning model

☆26Sep 21, 2022Updated 4 years ago

Alternatives and similar repositories for pyInfer

Users that are interested in pyInfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

• leon0514 / cuda-sahi-crop-image

  View on GitHub
  使用cuda实现类似sahi库的切图
  ☆13Jul 21, 2026Updated 3 months ago
• sesmfs / onnx_quant_tool

  View on GitHub
  An onnx-based quantitation tool.
  ☆71Jan 8, 2024Updated 2 years ago
• zjd1988 / rknn_backend

  View on GitHub
  ☆19Jan 19, 2024Updated 2 years ago
• sesmfs / onnx_matcher

  View on GitHub
  Using pattern matcher in onnx model to match and replace subgraphs.
  ☆81Feb 7, 2024Updated 2 years ago
• shouxieai / cpp-rotation-album

  View on GitHub
  cpp rotation album，基于cpp eigen实现的3d旋转相册，GAMES101复现内容
  ☆12Jul 25, 2022Updated 4 years ago
• AI Agents on DigitalOcean Gradient AI Platform • Ad
  Build production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
• alexw914 / RK_VideoPipe

  View on GitHub
  ☆123Aug 1, 2024Updated 2 years ago
• richjjj / duscratch

  View on GitHub
  搜藏的希望的代码片段
  ☆13Jun 6, 2023Updated 3 years ago
• hopef / llama3_chat

  View on GitHub
  Llama3 Streaming Chat Sample
  ☆22Apr 24, 2024Updated 2 years ago
• BaofengZan / my_trt_pro

  View on GitHub
  跟着Tensorrt_pro学习各种知识
  ☆39Nov 25, 2022Updated 3 years ago
• laugh12321 / model_crypto

  View on GitHub
  A Python and C++ library for model encryption and decryption, built on Crypto++, with support for various deep learning frameworks includ…
  ☆52Oct 27, 2023Updated 3 years ago
• Guanbin-Huang / camera_calibration_cpp

  View on GitHub
  ☆19Aug 23, 2022Updated 4 years ago
• BaofengZan / hard_decode_trt-windows

  View on GitHub
  https://github.com/shouxieai/hard_decode_trt windows编译版本
  ☆13Sep 8, 2022Updated 4 years ago
• cvdong / YOLO_TRT_SIM

  View on GitHub
  高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀
  ☆54Feb 23, 2023Updated 3 years ago
• yhwang-hub / dl_model_infer

  View on GitHub
  🚀🚀🚀This is an AI high-performance reasoning C++ library, Currently supports the deployment of yolov5, yolov7, yolov7-pose, yolov8, yol…
  ☆137May 4, 2024Updated 2 years ago
• Deploy on Railway without the complexity - Free Credits Offer • Ad
  Connect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
• wangzyon / trt_learn

  View on GitHub
  TensorRT encapsulation, learn, rewrite, practice.
  ☆32Oct 19, 2022Updated 4 years ago
• CYYAI / AiInfer

  View on GitHub
  ☆114Mar 11, 2024Updated 2 years ago
• 1461521844lijin / trt_yolo_video_pipeline

  View on GitHub
  TensorRT+YOLO系列的 多路 多卡 多实例 并行视频分析处理案例
  ☆337Feb 10, 2025Updated last year
• xuansan / openvisionforge

  View on GitHub
   是一个 **Rust-first 的开源工业视觉检测工作流平台**。 它的目标不是做一个单独的算法 demo，也不是做一个只能拖拽配置的低代码工具，而是做一个可以长期扩展的工业视觉检测底座：用 Rust runtime 负责真正的 workflow 执行，用节…
  ☆16Jul 22, 2026Updated 3 months ago
• shouxieai / hard_decode_trt

  View on GitHub
  Yolov5 inference on NVDec hardware decoder
  ☆91Nov 6, 2021Updated 4 years ago
• shouxieai / cpp-proj-template

  View on GitHub
  cpp project template based on visual studio, OpenCV and CUDA, gdb debug, makefile
  ☆25Nov 19, 2021Updated 4 years ago
• yuxiaoranyu / stable_diffusion_trt_triton

  View on GitHub
  ☆20Dec 29, 2023Updated 2 years ago
• Guanbin-Huang / tensorRT_Pro_co-comments

  View on GitHub
  ☆119Aug 13, 2023Updated 3 years ago
• sesmfs / 360-Surround-View-CUDA-Project

  View on GitHub
  10000 fps 🚀 for 360 Surround-View CUDA Solution
  ☆151Dec 23, 2023Updated 2 years ago
• GPU virtual machines on DigitalOcean Gradient AI • Ad
  Get to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
• raymond1123 / Flash-Attention

  View on GitHub
  ☆26Nov 21, 2024Updated last year
• delta1037 / RknnInferTemplate

  View on GitHub
  RKNN模型推理部署模板
  ☆24Aug 11, 2023Updated 3 years ago
• thanhlnbka / yolov7-triton-deepstream

  View on GitHub
  ☆25Oct 10, 2022Updated 4 years ago
• shouxieai / makefile_tutorial_project

  View on GitHub
  https://zhuanlan.zhihu.com/p/396448133
  ☆40Dec 8, 2021Updated 4 years ago
• raymond1123 / hgemm

  View on GitHub
  ☆30Nov 16, 2024Updated last year
• shouxieai / kiwi-rknn

  View on GitHub
  rknn inference
  ☆47Mar 7, 2022Updated 4 years ago
• shouxieai / infer

  View on GitHub
  A new tensorrt integrate. Easy to integrate many tasks
  ☆455Apr 2, 2023Updated 3 years ago
• yhwang-hub / dl_model_deploy

  View on GitHub
  ☆79May 16, 2023Updated 3 years ago
• NVIDIA-AI-IOT / tensorrt_plugin_generator

  View on GitHub
  A simple tool that can generate TensorRT plugin code quickly.
  ☆243Jul 11, 2023Updated 3 years ago
• GPUs on demand by Runpod - Special Offer Available • Ad
  Run AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
• yhwang-hub / yolov7_QAT

  View on GitHub
  Quantize yolov7 using pytorch_quantization.🚀🚀🚀
  ☆12Oct 20, 2023Updated 3 years ago
• NVIDIA-AI-IOT / cuDLA-samples

  View on GitHub
  YOLOv5 on Orin DLA
  ☆228Feb 18, 2024Updated 2 years ago
• leon0514 / trt-sahi-yolo

  View on GitHub
  Accelerating SAHI-based inference on YOLO models using TensorRT.
  ☆108Jan 6, 2026Updated 9 months ago
• olibartfast / tritonic

  View on GitHub
  C++ application to perform computer vision tasks using Nvidia Triton Server for model inference
  ☆30Oct 20, 2026Updated last week
• Plumess / yolov5-qnn

  View on GitHub
  YOLOv5在高通AI Engine Direct环境下进行QNN量化，CPU推理的项目
  ☆17Sep 10, 2024Updated 2 years ago
• Melody-Zhou / tensorRT_Pro-Vision

  View on GitHub
  This repository is forked from shouxieai/tensorRT_Pro, extending it to support a wide range of vision models with high-performance Tensor…
  ☆415Updated this week
• thb1314 / tensorrt-onnx-fasterrcnn-fpn-roialign

  View on GitHub
  ☆53Mar 27, 2023Updated 3 years ago