layerism / TensorRT-Inference-Server-TutorialLinks
服务侧深度学习部署案例
☆451Updated 5 years ago
Alternatives and similar repositories for TensorRT-Inference-Server-Tutorial
Users that are interested in TensorRT-Inference-Server-Tutorial are comparing it to the libraries listed below
Sorting:
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆528Updated 3 years ago
- A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX☆247Updated 4 years ago
- NVIDIA TensorRT 加速推 断教程!☆134Updated 3 years ago
- ☆1,033Updated last year
- Deploy your model with TensorRT quickly.☆768Updated last year
- Pytorch-->onnx-->TensorRT; CUDA11, CUDNN8, TensorRT8☆210Updated last year
- TensorRT ONNX Plugin、Inference、Compile☆469Updated 3 years ago
- ⚡ Useful scripts when using TensorRT☆242Updated 4 years ago
- A library for high performance deep learning inference on NVIDIA GPUs.☆553Updated 3 years ago
- Implement popular deep learning networks in pytorch, used by tensorrtx.☆196Updated 3 years ago
- Code for some onnxruntime projects☆122Updated 4 years ago
- A pytorch to tensorrt convert with dynamic shape support☆260Updated last year
- TensorRT Plugin Autogen Tool☆369Updated 2 years ago
- ☆80Updated 4 years ago
- 针对pytorch模型的自动化模型 结构分析和修改工具集,包含自动分析模型结构的模型压缩算法库☆249Updated 2 years ago
- volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.☆287Updated 4 years ago
- Trans different platform's network to International Representation(IR)☆44Updated 7 years ago
- 通用深度学习推理工具,可在生产环境中快速上线由TensorFlow、PyTorch、Caffe框架训练出的深度学习模型。☆410Updated 3 years ago
- A brief of TorchScript by MNIST☆112Updated 2 years ago
- Useful tensorrt plugin. For pytorch and mmdetection model conversion.☆164Updated 8 months ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆285Updated 3 years ago
- www.giantpandacv.com☆149Updated last year
- ☆99Updated 3 years ago
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆598Updated last year
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆400Updated 2 years ago
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- thor: C++ helper library, for deep learning purpose☆277Updated 2 years ago
- tensorrt wheels (API)☆77Updated 4 years ago
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆504Updated 7 months ago
- pytorch -> onnx -> caffe, pytorch to caffe, or other deep learning framework to onnx and onnx to caffe.☆162Updated 4 years ago