A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆72May 3, 2024Updated last year
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below
Sorting:
- Study notes in Chinese based on Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)☆12Aug 4, 2022Updated 3 years ago
- Collection of blogs on AI development☆23Nov 13, 2024Updated last year
- [MobiCom 24] Memory-adaptive DNN inference on edge☆58Jan 22, 2025Updated last year
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆15Dec 17, 2019Updated 6 years ago
- ☆10Dec 7, 2022Updated 3 years ago
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆47Jun 18, 2022Updated 3 years ago
- CoPur: Certifiably Robust Collaborative Inference via Feature Purification (NeurIPS 2022)☆11Dec 7, 2022Updated 3 years ago
- learning-cuda-trt☆119Feb 23, 2023Updated 3 years ago
- Interface for inertial(oxts2000) and lidar(velodyne hdl-32e)☆10Mar 8, 2018Updated 8 years ago
- Multi-Organ Foundation Model for Universal Ultrasound Image Segmentation with Task Prompt and Anatomical Prior☆16Sep 30, 2024Updated last year
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 3 years ago
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆13Sep 12, 2023Updated 2 years ago
- 手势相关资源整理，针对keypoint的检测☆17Aug 25, 2017Updated 8 years ago
- 当下热门的模糊人脸修复模型的部署，分别是：Codeformer，GFPGAN，GPEN，Restoreformer☆38Sep 14, 2023Updated 2 years ago
- ☆13Aug 14, 2023Updated 2 years ago
- 海康威视网络录像机（NVR）和网络摄像机（IPC）的封装类☆16Jun 9, 2020Updated 5 years ago
- ☆16Jul 4, 2021Updated 4 years ago
- ☆13Jan 8, 2021Updated 5 years ago
- Accelerating GOT-OCRv2 with VLLM☆11Nov 15, 2024Updated last year
- ☆11Sep 26, 2024Updated last year
- Helmet Detector based on the CenterNet.☆11Jan 30, 2022Updated 4 years ago
- Rethinking Whole-Body CT Image Interpretation: An Abnormality-Centric Approach☆19Nov 17, 2025Updated 4 months ago
- Code for paper "Locally Distributed Deep Learning Inference on Edge Device Clusters"☆15Aug 22, 2025Updated 7 months ago
- ☆42Jun 25, 2020Updated 5 years ago
- Code for paper ''Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging''☆12Nov 8, 2020Updated 5 years ago
- A toolkit for developers to simplify the transformation of nn.Module instances. It's now corresponding to Pytorch.fx.☆13Apr 7, 2023Updated 2 years ago
- Python Binding for realcugan-ncnn-vulkan with PyBind11☆12Dec 30, 2023Updated 2 years ago
- AAM Feature Extraction, Age Estimation, Face Aging☆16Mar 23, 2015Updated 10 years ago
- solving knapsack problem with n items with GA(genetic algorithm)☆11Feb 22, 2025Updated last year
- Text detection network psenet deployed by libtorch and Qt.☆14May 21, 2020Updated 5 years ago
- Official code release for paper "Improving Confidence Estimates for Unfamiliar Examples" https://arxiv.org/abs/1804.03166☆12Aug 16, 2020Updated 5 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！☆39Aug 26, 2024Updated last year
- Retinaface pytorch face-pose-detect face-key-point-detect☆36Mar 3, 2021Updated 5 years ago
- Freehand ultrasound without external trackers☆41Apr 18, 2025Updated 11 months ago
- Face recognition screen locker for Cinnamon☆11Nov 19, 2018Updated 7 years ago
- ☆15Dec 9, 2021Updated 4 years ago
- StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth prediction model in pytorch. ECCV2018☆12Aug 14, 2019Updated 6 years ago
- FreeCAD Workbench for URDF & SDF and Gazebo☆13Nov 21, 2019Updated 6 years ago
- GUI for MICCAI 2019 "Interactive deep editing framework for medical image segmentation" (One-click medical image segmentation tool!)☆12Jun 5, 2019Updated 6 years ago