A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆75May 3, 2024Updated 2 years ago
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Study notes in Chinese based on Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)☆12Aug 4, 2022Updated 4 years ago
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 2 years ago
- Repository for submodules containing code for MMAR 2023 "Detection-segmentation convolutional neural network for autonomous vehicle perc…☆28Jun 19, 2023Updated 3 years ago
- [MobiCom 24] Adaptive DNN inference under memory constraints☆58Jan 22, 2025Updated last year
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆14Dec 17, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Simulating the quantum approximate optimization algorithm with Matlab☆12Aug 26, 2021Updated 4 years ago
- Final year research project to design a programmable virtual switch based on the specifications of a TSN to be implemented on a TSN netwo…☆13Nov 17, 2020Updated 5 years ago
- learning-cuda-trt☆122Feb 23, 2023Updated 3 years ago
- ☆10Dec 7, 2022Updated 3 years ago
- Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"☆116Jun 10, 2026Updated 2 months ago
- Multi-Organ Foundation Model for Universal Ultrasound Image Segmentation with Task Prompt and Anatomical Prior☆15Sep 30, 2024Updated last year
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 3 years ago
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆13Sep 12, 2023Updated 2 years ago
- This is a release code of the paper "Fuzzy Attention Neural Network to Tackle Discontinuity in Airway Segmentation"☆18May 5, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official repository of the paper Face Presentation Attack Detection by Eacavating Causal Clues and Adapting Embedding Statistics☆14Aug 29, 2023Updated 2 years ago
- ☆14Aug 14, 2023Updated 2 years ago
- ☆16Jul 4, 2021Updated 5 years ago
- 海康威视网络录像机（NVR）和网络摄像机（IPC）的封装类☆17Jun 9, 2020Updated 6 years ago
- 当下热门的模糊人脸修复模型的部署，分别是：Codeformer，GFPGAN，GPEN，Restoreformer☆42Sep 14, 2023Updated 2 years ago
- Testing tools for Oracle Forms☆15Oct 23, 2025Updated 9 months ago
- Project on the implementation of deep-learning models for ship detection on SAR images.☆10Feb 28, 2023Updated 3 years ago
- Transfer Learning for Survival Analysis via Efficient L2,1-norm Regularized Cox Regression☆13Sep 18, 2016Updated 9 years ago
- CyclicSim: Different Variants of Cyclic Shapers in TSN☆14Jul 31, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆11Sep 26, 2024Updated last year
- [ICLR 2025] OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework☆60Mar 18, 2026Updated 4 months ago
- 一些数据处理相关的代码☆11Jan 16, 2021Updated 5 years ago
- Code for paper ''Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging''☆12Nov 8, 2020Updated 5 years ago
- Code for paper "Locally Distributed Deep Learning Inference on Edge Device Clusters"☆15Jul 22, 2026Updated 2 weeks ago
- ☆14Sep 2, 2024Updated last year
- ☆42Jun 25, 2020Updated 6 years ago
- Code examples to demonstrate the use of mlflow tracking and serving instances☆15Jul 25, 2023Updated 3 years ago
- Freehand ultrasound without external trackers☆43Apr 18, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Python Binding for realcugan-ncnn-vulkan with PyBind11☆12Dec 30, 2023Updated 2 years ago
- Text detection network psenet deployed by libtorch and Qt.☆14May 21, 2020Updated 6 years ago
- PrimeHub Python SDK☆13Apr 21, 2023Updated 3 years ago
- ☆14Nov 29, 2022Updated 3 years ago
- GUI for MICCAI 2019 "Interactive deep editing framework for medical image segmentation" (One-click medical image segmentation tool!)☆12Jun 5, 2019Updated 7 years ago
- ☆14Dec 9, 2021Updated 4 years ago
- ☆23Mar 13, 2022Updated 4 years ago