Alternatives and similar repositories for TensorRT-Inference-Server-Tutorial

Users that are interested in TensorRT-Inference-Server-Tutorial are comparing it to the libraries listed below

• RizhaoCai / PyTorch_ONNX_TensorRT
  A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX
  ☆247Updated 4 years ago
• Syencil / tensorRT
  TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据
  ☆533Updated 4 years ago
• dlunion / tensorRTIntegrate
  TensorRT ONNX Plugin、Inference、Compile
  ☆469Updated 4 years ago
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆768Updated last year
• AICVHub / Pytorch2TensorRT
  Pytorch-->onnx-->TensorRT; CUDA11, CUDNN8, TensorRT8
  ☆212Updated last year
• DataXujing / TensorRT_CV
  NVIDIA TensorRT 加速推断教程！
  ☆133Updated 4 years ago
• rmccorm4 / tensorrt-utils
  ⚡ Useful scripts when using TensorRT
  ☆239Updated 5 years ago
• Tencent / Forward
  A library for high performance deep learning inference on NVIDIA GPUs.
  ☆558Updated 3 years ago
• tenglike1997 / onnxruntime-projects
  Code for some onnxruntime projects
  ☆122Updated 4 years ago
• drcut / NN_transform
  Trans different platform's network to International Representation(IR)
  ☆44Updated 7 years ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆265Updated last year
• lucasjinreal / thor
  thor: C++ helper library, for deep learning purpose
  ☆277Updated 3 years ago
• wang-xinyu / pytorchx
  Implement popular deep learning networks in pytorch, used by tensorrtx.
  ☆197Updated 3 years ago
• inisis / brocolli
  Everything in Torch Fx
  ☆345Updated last year
• LitLeo / TensorRT_Tutorial
  ☆1,036Updated last year
• bindog / onnx-surgery
  ☆81Updated 4 years ago
• BBuf / onnx_learn
  ☆99Updated 4 years ago
• wuba / dl_inference
  通用深度学习推理工具，可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。
  ☆414Updated 3 years ago
• BBuf / giantpandacv.com
  www.giantpandacv.com
  ☆152Updated last year
• Media-Smart / volksdep
  volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.
  ☆287Updated 4 years ago
• wdhao / tensorRT_Wheels
  tensorrt wheels (API)
  ☆76Updated 4 years ago
• THU-MIG / torch-model-compression
  针对pytorch模型的自动化模型结构分析和修改工具集，包含自动分析模型结构的模型压缩算法库
  ☆252Updated 2 years ago
• aovoc / nnieqat-pytorch
  A nnie quantization aware training tool on pytorch.
  ☆239Updated 4 years ago
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆112Updated 3 years ago
• Tencent / TPAT
  TensorRT Plugin Autogen Tool
  ☆367Updated 2 years ago
• MTLab / onnx2caffe
  pytorch to caffe by onnx
  ☆376Updated 5 years ago
• deepglint / EasyQuant
  EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…
  ☆403Updated 2 years ago
• GuanLianzheng / pytorch_to_TensorRT5
  通过pytorch搭建卷积神经网络完成手写识别任务，并将训练好的模型以多种方式部署到TensorRT中加速。（1）通过加载权重。（2）通过加载onnx。（3）通过加载engine。
  ☆44Updated 6 years ago
• BBuf / onnx2X
  ONNX2Pytorch
  ☆162Updated 4 years ago
• grimoire / mmdetection-to-tensorrt
  convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.
  ☆599Updated last year