layerism / TensorRT-Inference-Server-Tutorial

Related projects ⓘ

Alternatives and complementary repositories for TensorRT-Inference-Server-Tutorial

• RizhaoCai / PyTorch_ONNX_TensorRT
  A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX
  ☆243Updated 3 years ago
• Syencil / tensorRT
  TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据
  ☆523Updated 3 years ago
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆762Updated last year
• DataXujing / TensorRT_CV
  NVIDIA TensorRT 加速推断教程！
  ☆132Updated 3 years ago
• dlunion / tensorRTIntegrate
  TensorRT ONNX Plugin、Inference、Compile
  ☆465Updated 3 years ago
• AICVHub / Pytorch2TensorRT
  Pytorch-->onnx-->TensorRT; CUDA11, CUDNN8, TensorRT8
  ☆194Updated last year
• tenglike1997 / onnxruntime-projects
  Code for some onnxruntime projects
  ☆120Updated 3 years ago
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆547Updated 2 years ago
• rmccorm4 / tensorrt-utils
  ⚡ Useful scripts when using TensorRT
  ☆240Updated 4 years ago
• LitLeo / TensorRT_Tutorial
  ☆990Updated 8 months ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆257Updated 9 months ago
• wang-xinyu / pytorchx
  Implement popular deep learning networks in pytorch, used by tensorrtx.
  ☆191Updated 2 years ago
• Tencent / TPAT
  TensorRT Plugin Autogen Tool
  ☆367Updated last year
• Media-Smart / volksdep
  volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.
  ☆286Updated 3 years ago
• grimoire / mmdetection-to-tensorrt
  convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.
  ☆589Updated 9 months ago
• wuba / dl_inference
  通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
  ☆407Updated 2 years ago
• xxradon / ONNXToCaffe
  pytorch -> onnx -> caffe, pytorch to caffe, or other deep learning framework to onnx and onnx to caffe.
  ☆158Updated 3 years ago
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆279Updated 2 years ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 2 years ago
• bindog / onnx-surgery
  ☆78Updated 4 years ago
• grimoire / amirstan_plugin
  Useful tensorrt plugin. For pytorch and mmdetection model conversion.
  ☆159Updated last month
• lucasjinreal / thor
  thor: C++ helper library, for deep learning purpose
  ☆270Updated 2 years ago
• Wulingtian / yolov5_tensorrt_int8_tools
  tensorrt int8 量化yolov5 onnx模型
  ☆176Updated 3 years ago
• BBuf / onnx_learn
  ☆96Updated 3 years ago
• JosephChenHub / CenterNet-TensorRT
  This is a C++ implementation of CenterNet using TensorRT and CUDA
  ☆149Updated last year
• BBuf / onnx2X
  ONNX2Pytorch
  ☆159Updated 3 years ago
• NVIDIA-AI-IOT / tensorrt_plugin_generator
  A simple tool that can generate TensorRT plugin code quickly.
  ☆221Updated last year
• BBuf / giantpandacv.com
  www.giantpandacv.com
  ☆149Updated 5 months ago
• wdhao / tensorRT_Wheels
  tensorrt wheels (API)
  ☆77Updated 3 years ago