A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆73May 3, 2024Updated 2 years ago
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for submodules containing code for MMAR 2023 "Detection-segmentation convolutional neural network for autonomous vehicle perc…☆29Jun 19, 2023Updated 2 years ago
- Collection of blogs on AI development☆23Nov 13, 2024Updated last year
- [MobiCom 24] Adaptive DNN inference under memory constraints☆57Jan 22, 2025Updated last year
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆14Dec 17, 2019Updated 6 years ago
- ☆10Dec 7, 2022Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆47Jun 18, 2022Updated 3 years ago
- 基于yolov5，在woodscape数据集上实现旋转框目标检测+语义分割☆13Mar 4, 2024Updated 2 years ago
- A modular management and configuration framework for distributed real-time applications in a TSN-based network☆10Sep 5, 2024Updated last year
- Official repository of the paper Face Presentation Attack Detection by Eacavating Causal Clues and Adapting Embedding Statistics☆14Aug 29, 2023Updated 2 years ago
- Multi-Organ Foundation Model for Universal Ultrasound Image Segmentation with Task Prompt and Anatomical Prior☆16Sep 30, 2024Updated last year
- A Visual Studio project demonstrating how to perform object tracking across video frames with YOLOX, ONNX Runtime, and the ByteTrack-Eige…☆12Nov 19, 2023Updated 2 years ago
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 3 years ago
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆13Sep 12, 2023Updated 2 years ago
- 手势相关资源整理，针对keypoint的检测☆17Aug 25, 2017Updated 8 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆15Aug 7, 2025Updated 10 months ago
- 当下热门的模糊人脸修复模型的部署，分别是：Codeformer，GFPGAN，GPEN，Restoreformer☆42Sep 14, 2023Updated 2 years ago
- Solutions to CS373 course taught by Sebastian Thrun on Udacity.☆13Apr 13, 2017Updated 9 years ago
- ☆13Aug 14, 2023Updated 2 years ago
- ☆13Jan 8, 2021Updated 5 years ago
- Track 1: Driving with Language☆26Aug 23, 2025Updated 9 months ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- ☆11Sep 26, 2024Updated last year
- Helmet Detector based on the CenterNet.☆11Jan 30, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [CVPR 2026 Findings] Rethinking Whole-Body CT Image Interpretation: An Abnormality-Centric Approach☆22Updated this week
- ☆42Jun 25, 2020Updated 5 years ago
- Code for paper ''Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging''☆12Nov 8, 2020Updated 5 years ago
- FFBNET : LIGHTWEIGHT BACKBONE FOR OBJECT DETECTION BASED FEATURE FUSION BLOCK☆13May 16, 2019Updated 7 years ago
- Python Binding for realcugan-ncnn-vulkan with PyBind11☆12Dec 30, 2023Updated 2 years ago
- AAM Feature Extraction, Age Estimation, Face Aging☆16Mar 23, 2015Updated 11 years ago
- solving knapsack problem with n items with GA(genetic algorithm)☆10May 17, 2026Updated 3 weeks ago
- ☆25Aug 29, 2025Updated 9 months ago
- Retinaface pytorch face-pose-detect face-key-point-detect☆36Mar 3, 2021Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Image classifier to help TensorFlow Lite C++ API usage with Bazel.☆12Oct 12, 2021Updated 4 years ago
- Freehand ultrasound without external trackers☆41Apr 18, 2025Updated last year
- StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth prediction model in pytorch. ECCV2018☆12Aug 14, 2019Updated 6 years ago
- GUI for MICCAI 2019 "Interactive deep editing framework for medical image segmentation" (One-click medical image segmentation tool!)☆12Jun 5, 2019Updated 7 years ago
- 基于Tornado、Redis、UDP多播的分布式聊天室☆17May 29, 2013Updated 13 years ago
- 一些收藏☆15Jan 22, 2016Updated 10 years ago
- A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…☆14Feb 7, 2025Updated last year