A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆72May 3, 2024Updated last year
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below
Sorting:
- Study notes in Chinese based on Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)☆11Aug 4, 2022Updated 3 years ago
- Official code release for paper "Improving Confidence Estimates for Unfamiliar Examples" https://arxiv.org/abs/1804.03166☆12Aug 16, 2020Updated 5 years ago
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 2 years ago
- Helmet Detector based on the CenterNet.☆11Jan 30, 2022Updated 4 years ago
- Semantic Segmentation on the LaPa dataset using Pytorch Lightning☆14Nov 4, 2021Updated 4 years ago
- unofficial pytorch implementation Anime Sketch Coloring with Swish-Gated Residual U-Net☆13Oct 3, 2023Updated 2 years ago
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 3 years ago
- Retinaface pytorch face-pose-detect face-key-point-detect☆36Mar 3, 2021Updated 4 years ago
- 基于ncnn的android端的enet分割☆17Mar 29, 2020Updated 5 years ago
- Official implementation of "ResAD: Normalized Residual Trajectory Modeling for End-to-End Autonomous Driving"☆61Oct 9, 2025Updated 4 months ago
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆48Jun 18, 2022Updated 3 years ago
- This repository is TensorRT implement of PINet☆18Nov 1, 2022Updated 3 years ago
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆15Dec 17, 2019Updated 6 years ago
- Code for reproducing "AC/DC: Alternating Compressed/DeCompressed Training of Deep Neural Networks" (NeurIPS 2021)☆23Nov 9, 2021Updated 4 years ago
- 手势相关资源整理，针对keypoint的检测☆17Aug 25, 2017Updated 8 years ago
- This is a PyTorch implementation of "VirFace: Enhancing Face Recognition via Unlabeled Shallow Data" (CVPR 2021).☆22Sep 30, 2022Updated 3 years ago
- convert a pytorch model to a model for edge device☆20Mar 15, 2023Updated 2 years ago
- TIP: Bi-directional Exponential Angular Triplet Loss for RGB-Infrared Person Re-Identification☆22Mar 29, 2021Updated 4 years ago
- pytorch 使用centernet进行 人脸检测Face Detection (bbox + landmark)、 船只检测SeaShips Detection☆48Feb 15, 2020Updated 6 years ago
- Describes how to run DBFace, a real-time, single-shot face detection model on Intel OpenVINO☆29Aug 23, 2020Updated 5 years ago
- [MobiCom 24] Memory-adaptive DNN inference on edge☆58Jan 22, 2025Updated last year
- PyTorch implementation of the SonoNet Ultrasound standard plane detector☆22Sep 30, 2020Updated 5 years ago
- Repository for submodules containing code for MMAR 2023 "Detection-segmentation convolutional neural network for autonomous vehicle perc…☆29Jun 19, 2023Updated 2 years ago
- Retinaface人脸检测网络 MNN、NCNN嵌入式，Linux端推理源码，包含一个卡通人脸检测的模型，脚本一键构建可执行程序☆25Jul 27, 2021Updated 4 years ago
- Automatic tool for standard plane localisation in 3D ultrasound☆26Oct 6, 2018Updated 7 years ago
- ☆26Jul 7, 2021Updated 4 years ago
- ☆25Aug 27, 2021Updated 4 years ago
- Android，MNN，人脸检测☆24Mar 13, 2023Updated 2 years ago
- A lightweight face recognition, high accuracy, real-time, cross-platform☆29Oct 31, 2025Updated 4 months ago
- How to export PyTorch models with unsupported layers to ONNX and then to Intel OpenVINO☆28Feb 20, 2025Updated last year
- learning-cuda-trt☆119Feb 23, 2023Updated 3 years ago
- ☆20Oct 14, 2025Updated 4 months ago
- Libraries, guides, blueprints, and sample code, to enable rapidly building 0-1 applications on iOS, Android and web.☆11May 12, 2023Updated 2 years ago
- DAA: A Delta Age AdaIN operation for age estimation via binary code transformer (CVPR2023)☆37Mar 10, 2025Updated 11 months ago
- Examples for the HEBI Robotics Python API☆14Jan 9, 2026Updated last month
- C++ implementations of YOLOv8/YOLO26, RT-DETR-V2(RTDETR), MobileSAM, and NanoSAM on TensorRT, ONNX Runtime, and RKNN.☆50Jan 16, 2026Updated last month
- ☆10Sep 10, 2025Updated 5 months ago
- Official Code for All-in-One Medical Image Re-Identification (CVPR2025)☆18Jan 11, 2026Updated last month
- Freehand ultrasound without external trackers☆41Apr 18, 2025Updated 10 months ago