Tramac / tensorrt-tutorial
TensorRT简明教程
☆26Updated 3 years ago
Alternatives and similar repositories for tensorrt-tutorial:
Users that are interested in tensorrt-tutorial are comparing it to the libraries listed below
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆48Updated last year
- ☆17Updated 2 years ago
- A tool convert TensorRT engine/plan to a fake onnx☆37Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆41Updated last year
- TensorRT 2022 亚军方案,tensorrt加速mobilevit模型☆61Updated 2 years ago
- 国内外数据竞赛资讯整理☆18Updated 3 years ago
- ☆23Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆44Updated last year
- For 2022 Nvidia Hackathon☆20Updated 2 years ago
- An onnx-based quantitation tool.☆71Updated last year
- Trans different platform's network to International Representation(IR)☆44Updated 6 years ago
- Bert TensorRT模型加速部署☆9Updated 2 years ago
- 高效部署:YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀☆49Updated last year
- 大模型部署实战:TensorRT-LLM, Triton Inference Server, vLLM☆26Updated 11 months ago
- tensorrt yolov7 without onnxparser☆24Updated 2 years ago
- A Python and C++ library for model encryption and decryption, built on Crypto++, with support for various deep learning frameworks includ…☆40Updated last year
- ☆120Updated last year
- ☆42Updated last year
- ☆78Updated last year
- 使用ONNXRuntime部署PP-YOLOE目标检测,支持PP-YOLOE-s、PP-YOLOE-m、PP-YOLOE-l、PP-YOLOE-x四种结构,包含C++和Python两个版本的程序☆18Updated 2 years ago
- miemienet is a C++ AI deep learning inference framework.Supports PPYOLOE、PICODET.☆11Updated 2 years ago
- ☆97Updated 3 years ago
- Using TensorRT for Inference Model Deployment.☆47Updated last year
- Compare multiple optimization methods on triton to imporve model service performance☆48Updated last year
- ☆78Updated last year
- deploy onnx models with TensorRT and LibTorch☆17Updated 3 years ago
- YOLOv5 in PyTorch > ONNX > CoreML > iOS☆9Updated 6 months ago
- TensorRT 2022复赛方案: 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆138Updated 2 years ago
- 使用ONNXRuntime部署阿里达摩院开源DAMO-YOLO目标检测,一共包含27个onnx模型,依然是包含了C++和Python两个版本的程序☆31Updated 2 years ago
- 分别使用OpenCV、ONNXRuntime部署CenterNet目标检测,包含C++和Python两个版本的程序☆9Updated 2 years ago