A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆73May 3, 2024Updated 2 years ago
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Study notes in Chinese based on Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)☆12Aug 4, 2022Updated 3 years ago
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 2 years ago
- [MobiCom 24] Memory-adaptive DNN inference on edge☆57Jan 22, 2025Updated last year
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆14Dec 17, 2019Updated 6 years ago
- learning-cuda-trt☆121Feb 23, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆47Jun 18, 2022Updated 3 years ago
- CoPur: Certifiably Robust Collaborative Inference via Feature Purification (NeurIPS 2022)☆11Dec 7, 2022Updated 3 years ago
- Interface for inertial(oxts2000) and lidar(velodyne hdl-32e)☆10Mar 8, 2018Updated 8 years ago
- A modular management and configuration framework for distributed real-time applications in a TSN-based network☆10Sep 5, 2024Updated last year
- 目标检测开源代码☆14Sep 27, 2018Updated 7 years ago
- Multi-Organ Foundation Model for Universal Ultrasound Image Segmentation with Task Prompt and Anatomical Prior☆16Sep 30, 2024Updated last year
- A Visual Studio project demonstrating how to perform object tracking across video frames with YOLOX, ONNX Runtime, and the ByteTrack-Eige…☆12Nov 19, 2023Updated 2 years ago
- Official repository of the paper Face Presentation Attack Detection by Eacavating Causal Clues and Adapting Embedding Statistics☆14Aug 29, 2023Updated 2 years ago
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆13Sep 12, 2023Updated 2 years ago
- 手势相关资源整理，针对keypoint的检测☆17Aug 25, 2017Updated 8 years ago
- 2019-2020春季学期 清华大学电子工程系 研究生课程 模式识别☆10Nov 27, 2020Updated 5 years ago
- ☆15Aug 7, 2025Updated 9 months ago
- 当下热门的模糊人脸修复模型的部署，分别是：Codeformer，GFPGAN，GPEN，Restoreformer☆41Sep 14, 2023Updated 2 years ago
- Master Thesis☆11Jan 28, 2023Updated 3 years ago
- 海康威视网络录像机（NVR）和网络摄像机（IPC）的封装类☆16Jun 9, 2020Updated 5 years ago
- ☆13Jan 8, 2021Updated 5 years ago
- 一些数据处理相关的代码☆11Jan 16, 2021Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Simulating the quantum approximate optimization algorithm with Matlab☆12Aug 26, 2021Updated 4 years ago
- Code for paper "Locally Distributed Deep Learning Inference on Edge Device Clusters"☆15Aug 22, 2025Updated 9 months ago
- ☆42Jun 25, 2020Updated 5 years ago
- Code for paper ''Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging''☆12Nov 8, 2020Updated 5 years ago
- A toolkit for developers to simplify the transformation of nn.Module instances. It's now corresponding to Pytorch.fx.☆13Apr 7, 2023Updated 3 years ago
- AAM Feature Extraction, Age Estimation, Face Aging☆16Mar 23, 2015Updated 11 years ago
- Text detection network psenet deployed by libtorch and Qt.☆14May 21, 2020Updated 6 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！☆39Aug 26, 2024Updated last year
- ☆14Nov 29, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Retinaface pytorch face-pose-detect face-key-point-detect☆36Mar 3, 2021Updated 5 years ago
- Image classifier to help TensorFlow Lite C++ API usage with Bazel.☆12Oct 12, 2021Updated 4 years ago
- ☆15Dec 9, 2021Updated 4 years ago
- https://github.com/shouxieai/hard_decode_trt windows编译版本☆13Sep 8, 2022Updated 3 years ago
- GUI for MICCAI 2019 "Interactive deep editing framework for medical image segmentation" (One-click medical image segmentation tool!)☆12Jun 5, 2019Updated 6 years ago
- 基于Tornado、Redis、UDP多播的分布式聊天室☆17May 29, 2013Updated 12 years ago
- 清华大学软件学院-数据结构C++/qt大作业☆12Sep 2, 2020Updated 5 years ago