A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆75May 3, 2024Updated 2 years ago
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 2 years ago
- Repository for submodules containing code for MMAR 2023 "Detection-segmentation convolutional neural network for autonomous vehicle perc…☆28Jun 19, 2023Updated 3 years ago
- Collection of blogs on AI development☆23Nov 13, 2024Updated last year
- A collection of awesome Machine Learning software, libraries, Learning Tutorials, documents, books, resources and interesting stuff in …☆31May 17, 2023Updated 3 years ago
- [MobiCom 24] Adaptive DNN inference under memory constraints☆59Jan 22, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- AutoregressModel-AE_VAD_CVPR2019 (code reimplemetation)☆12Oct 10, 2020Updated 5 years ago
- A Visual Studio project demonstrating how to perform object tracking across video frames with YOLOX, ONNX Runtime, and the ByteTrack-Eige…☆12Nov 19, 2023Updated 2 years ago
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆14Dec 17, 2019Updated 6 years ago
- learning-cuda-trt☆122Feb 23, 2023Updated 3 years ago
- ☆10Dec 7, 2022Updated 3 years ago
- CoPur: Certifiably Robust Collaborative Inference via Feature Purification (NeurIPS 2022)☆11Dec 7, 2022Updated 3 years ago
- 基于yolov5，在woodscape数据集上实现旋转框目标检测+语义分割☆13Mar 4, 2024Updated 2 years ago
- Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"☆116Jun 10, 2026Updated 2 months ago
- A modular management and configuration framework for distributed real-time applications in a TSN-based network☆11Sep 5, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 3 years ago
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆13Sep 12, 2023Updated 2 years ago
- ☆11Updated this week
- ☆14Aug 14, 2023Updated 3 years ago
- Demo app with Loguru logging, async middleware to generate X-request-Id. Works with Gunicorn or Uvicorn, and is safe to use with async/th…☆10Feb 2, 2022Updated 4 years ago
- Solutions to CS373 course taught by Sebastian Thrun on Udacity.☆14Apr 13, 2017Updated 9 years ago
- ☆16Jul 4, 2021Updated 5 years ago
- solving knapsack problem with n items with GA(genetic algorithm)☆10May 17, 2026Updated 3 months ago
- 海康威视网络录像机（NVR）和网络摄像机（IPC）的封装类☆17Jun 9, 2020Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Testing tools for Oracle Forms☆15Oct 23, 2025Updated 10 months ago
- Contains configuration files and scripts to perform Time-Sensitive Networking tests on a hardware testbed. Specifically the IEEE 802.1CB …☆13Jun 7, 2022Updated 4 years ago
- Code for paper "Locally Distributed Deep Learning Inference on Edge Device Clusters"☆15Jul 22, 2026Updated last month
- ☆14Sep 2, 2024Updated last year
- ☆42Jun 25, 2020Updated 6 years ago
- This repo solves The Knapsack problem with the genetic algorithms.☆15Dec 18, 2018Updated 7 years ago
- Freehand ultrasound without external trackers☆43Apr 18, 2025Updated last year
- PrimeHub Python SDK☆13Apr 21, 2023Updated 3 years ago
- ☆19Jan 9, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Nov 29, 2022Updated 3 years ago
- Implementation of the paper "A survey on attention mechanisms for medical applications: are we moving towards better algorithms?" by Tiag…☆13Sep 25, 2022Updated 3 years ago
- ☆14Dec 9, 2021Updated 4 years ago
- AI-ML Based Dehazing / De-smoking Algorithm☆20Feb 24, 2025Updated last year
- ☆16Jan 8, 2020Updated 6 years ago
- Decompiler for Oracle FMX files version 6☆18Nov 28, 2023Updated 2 years ago
- 一些收藏☆15Jan 22, 2016Updated 10 years ago