Yulv-git / Model-Inference-DeploymentLinks
A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆69Updated last year
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below
Sorting:
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆70Updated 2 years ago
- A large number of cuda/tensorrt cases . 大量案例来学习cuda/tensorrt☆155Updated 3 years ago
- A simple tool that can generate TensorRT plugin code quickly.☆236Updated 2 years ago
- ☆120Updated 2 years ago
- YOLOv5 on Orin DLA☆213Updated last year
- NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.☆218Updated last year
- Serving Inside Pytorch☆163Updated last week
- ☆140Updated last year
- An onnx-based quantitation tool.☆71Updated last year
- Offline Quantization Tools for Deploy.☆138Updated last year
- A simple tutorial of SNPE.☆179Updated 2 years ago
- TensorRT 7 C++ (almost) minimal examples☆83Updated last year
- ☆47Updated 2 years ago
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆71Updated 4 months ago
- TensorRT 2022 亚军方案,tensorrt加速mobilevit模型☆68Updated 3 years ago
- Using pattern matcher in onnx model to match and replace subgraphs.☆81Updated last year
- ☆79Updated 2 years ago
- learning-cuda-trt☆119Updated 2 years ago
- PyTorch Quantization Aware Training(QAT,量化感知训练)☆37Updated last year
- YOLOv5 Quantization Aware Training (QAT, qat_torch branch) and Post Training Quantization with ONNX (ptq_onnx branch ptq_onnx.ipynb)☆16Updated 2 years ago
- ☆43Updated 3 years ago
- This is 8-bit quantization sample for yolov5. Both PTQ, QAT and Partial Quantization have been implemented, and present the results based…☆109Updated 3 years ago
- yolov5 tensorrt int8量化方法汇总☆83Updated last year
- ☆150Updated last year
- Edgeai TIDL Tools and Examples - This repository contains Tools and example developed for Deep learning runtime (DLRT) offering provided …☆173Updated 2 weeks ago
- This is a repository to practice multi-thread programming in C++☆26Updated last year
- NVIDIA-阿里2021 TRT比赛 `二等奖` 代码提交 团队:美迪康 AI Lab☆172Updated 3 years ago
- Speed up image preprocess with cuda when handle image or tensorrt inference☆77Updated 2 weeks ago
- ☆26Updated 2 years ago
- 跟着Tensorrt_pro学习各种知识☆40Updated 2 years ago