layerism / TensorRT-Inference-Server-TutorialLinks
服务侧深度学习部署案例
☆451Updated 5 years ago
Alternatives and similar repositories for TensorRT-Inference-Server-Tutorial
Users that are interested in TensorRT-Inference-Server-Tutorial are comparing it to the libraries listed below
Sorting:
- NVIDIA TensorRT 加速推断教程!☆134Updated 3 years ago
- TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据☆528Updated 3 years ago
- Pytorch-->onnx-->TensorRT; CUDA11, CUDNN8, TensorRT8☆209Updated last year
- A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX☆245Updated 4 years ago
- ⚡ Useful scripts when using TensorRT☆242Updated 4 years ago
- TensorRT ONNX Plugin、Inference、Compile☆469Updated 3 years ago
- Deploy your model with TensorRT quickly.☆768Updated last year
- Code for some onnxruntime projects☆122Updated 4 years ago
- ☆1,026Updated last year
- ☆99Updated 3 years ago
- A pytorch to tensorrt convert with dynamic shape support☆261Updated last year
- Implement popular deep learning networks in pytorch, used by tensorrtx.☆196Updated 3 years ago
- A library for high performance deep learning inference on NVIDIA GPUs.☆552Updated 3 years ago
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- ☆80Updated 4 years ago
- thor: C++ helper library, for deep learning purpose☆277Updated 2 years ago
- tensorrt wheels (API)☆77Updated 4 years ago
- A brief of TorchScript by MNIST☆111Updated 2 years ago
- pytorch -> onnx -> caffe, pytorch to caffe, or other deep learning framework to onnx and onnx to caffe.☆162Updated 4 years ago
- volksdep is an open-source toolbox for deploying and accelerating PyTorch, ONNX and TensorFlow models with TensorRT.☆287Updated 4 years ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆285Updated 3 years ago
- 针对pytorch模型的自动化模型结构分析和修改工具集,包含自动分析模型结构的模型压缩算法库☆249Updated 2 years ago
- ONNX2Pytorch☆162Updated 4 years ago
- This is a C++ implementation of CenterNet using TensorRT and CUDA☆146Updated 2 years ago
- www.giantpandacv.com☆148Updated 11 months ago
- A nnie quantization aware training tool on pytorch.☆239Updated 4 years ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆400Updated 2 years ago
- convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.☆597Updated last year
- caffe model convert to onnx model☆176Updated 2 years ago
- A small deep-learning framework with C++/Python/CUDA☆54Updated 7 years ago