layerism / TensorRT-Inference-Server-TutorialLinks
服务侧深度学习部署案例
☆454Updated 5 years ago
Alternatives and similar repositories for TensorRT-Inference-Server-Tutorial
Users that are interested in TensorRT-Inference-Server-Tutorial are comparing it to the libraries listed below
Sorting:
- A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX☆247Updated 4 years ago
- TensorRT ONNX Plugin、Inference、Compile☆467Updated 4 years ago
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆532Updated 4 years ago
- ⚡ Useful scripts when using TensorRT☆239Updated 5 years ago
- NVIDIA TensorRT 加速推断教程!☆134Updated 4 years ago
- Deploy your model with TensorRT quickly.☆765Updated last year
- Pytorch-->onnx-->TensorRT; CUDA11, CUDNN8, TensorRT8☆211Updated last year
- Code for some onnxruntime projects☆121Updated 4 years ago
- A pytorch to tensorrt convert with dynamic shape support☆265Updated last year
- A library for high performance deep learning inference on NVIDIA GPUs.☆557Updated 3 years ago
- Implement popular deep learning networks in pytorch, used by tensorrtx.☆197Updated 3 years ago
- volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.☆287Updated 4 years ago
- thor: C++ helper library, for deep learning purpose☆276Updated 3 years ago
- ☆81Updated 4 years ago
- ☆1,037Updated last year
- 通用深度学习推理工具,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。☆413Updated 3 years ago
- ☆100Updated 4 years ago
- Trans different platform's network to International Representation(IR)☆44Updated 7 years ago
- Everything in Torch Fx☆345Updated last year
- tensorrt wheels (API)☆76Updated 4 years ago
- PyTorch C++ inference with LibTorch☆332Updated 4 years ago
- www.giantpandacv.com☆152Updated last year
- A brief of TorchScript by MNIST☆112Updated 3 years ago
- Use PyTorch model in C++ project☆140Updated 4 years ago
- TensorRT Plugin Autogen Tool☆368Updated 2 years ago
- pytorch -> onnx -> caffe, pytorch to caffe, or other deep learning framework to onnx and onnx to caffe.☆164Updated 4 years ago
- ONNX2Pytorch☆164Updated 4 years ago
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆598Updated last year
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆405Updated 2 years ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆287Updated 3 years ago