A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆72May 3, 2024Updated last year
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official implementation of "ResAD: Normalized Residual Trajectory Modeling for End-to-End Autonomous Driving"☆64Oct 9, 2025Updated 6 months ago
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 2 years ago
- Collection of blogs on AI development☆23Nov 13, 2024Updated last year
- [MobiCom 24] Memory-adaptive DNN inference on edge☆58Jan 22, 2025Updated last year
- ☆10Dec 7, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆47Jun 18, 2022Updated 3 years ago
- learning-cuda-trt☆121Feb 23, 2023Updated 3 years ago
- Interface for inertial(oxts2000) and lidar(velodyne hdl-32e)☆10Mar 8, 2018Updated 8 years ago
- 基于yolov5，在woodscape数据集上实现旋转框目标检测+语义分割☆13Mar 4, 2024Updated 2 years ago
- Multi-Organ Foundation Model for Universal Ultrasound Image Segmentation with Task Prompt and Anatomical Prior☆16Sep 30, 2024Updated last year
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆13Sep 12, 2023Updated 2 years ago
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 3 years ago
- 手势相关资源整理，针对keypoint的检测☆17Aug 25, 2017Updated 8 years ago
- 当下热门的模糊人脸修复模型的部署，分别是：Codeformer，GFPGAN，GPEN，Restoreformer☆39Sep 14, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- ☆13Aug 14, 2023Updated 2 years ago
- 海康威视网络录像机（NVR）和网络摄像机（IPC）的封装类☆16Jun 9, 2020Updated 5 years ago
- ☆13Jan 8, 2021Updated 5 years ago
- Track 1: Driving with Language☆26Aug 23, 2025Updated 7 months ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- Determine a schedule for running a set of jobs on a certain number of machines using the LeapHybridCQMSampler.☆16Feb 25, 2026Updated last month
- Demo app with Loguru logging, async middleware to generate X-request-Id. Works with Gunicorn or Uvicorn, and is safe to use with async/th…☆10Feb 2, 2022Updated 4 years ago
- ☆11Sep 26, 2024Updated last year
- Helmet Detector based on the CenterNet.☆11Jan 30, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- Rethinking Whole-Body CT Image Interpretation: An Abnormality-Centric Approach☆20Nov 17, 2025Updated 4 months ago
- Simulating the quantum approximate optimization algorithm with Matlab☆12Aug 26, 2021Updated 4 years ago
- ☆42Jun 25, 2020Updated 5 years ago
- Code for paper ''Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging''☆12Nov 8, 2020Updated 5 years ago
- FFBNET : LIGHTWEIGHT BACKBONE FOR OBJECT DETECTION BASED FEATURE FUSION BLOCK☆13May 16, 2019Updated 6 years ago
- Python Binding for realcugan-ncnn-vulkan with PyBind11☆12Dec 30, 2023Updated 2 years ago
- A toolkit for developers to simplify the transformation of nn.Module instances. It's now corresponding to Pytorch.fx.☆13Apr 7, 2023Updated 3 years ago
- AAM Feature Extraction, Age Estimation, Face Aging☆16Mar 23, 2015Updated 11 years ago
- solving knapsack problem with n items with GA(genetic algorithm)☆11Feb 22, 2025Updated last year
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- Text detection network psenet deployed by libtorch and Qt.☆14May 21, 2020Updated 5 years ago
- A curated collection of papers on E2E-AD, aimed at researchers, engineers, and enthusiasts in the field of autonomous driving systems. Th…☆90Mar 23, 2026Updated 2 weeks ago
- Rewriting Project Claw Code — Python rewrite of Claude Code agent harness. Forked from instructkr/claw-code.☆75Mar 31, 2026Updated last week
- Official code release for paper "Improving Confidence Estimates for Unfamiliar Examples" https://arxiv.org/abs/1804.03166☆12Aug 16, 2020Updated 5 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！☆39Aug 26, 2024Updated last year
- Image classifier to help TensorFlow Lite C++ API usage with Bazel.☆12Oct 12, 2021Updated 4 years ago
- Retinaface pytorch face-pose-detect face-key-point-detect☆36Mar 3, 2021Updated 5 years ago