A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆75May 3, 2024Updated 2 years ago
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Study notes in Chinese based on Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)☆12Aug 4, 2022Updated 4 years ago
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 2 years ago
- AutoregressModel-AE_VAD_CVPR2019 (code reimplemetation)☆12Oct 10, 2020Updated 5 years ago
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆14Dec 17, 2019Updated 6 years ago
- Simulating the quantum approximate optimization algorithm with Matlab☆12Aug 26, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Final year research project to design a programmable virtual switch based on the specifications of a TSN to be implemented on a TSN netwo…☆13Nov 17, 2020Updated 5 years ago
- learning-cuda-trt☆123Feb 23, 2023Updated 3 years ago
- ☆10Dec 7, 2022Updated 3 years ago
- ☆11May 17, 2023Updated 3 years ago
- Master Thesis☆11Jan 28, 2023Updated 3 years ago
- Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"☆118Jun 10, 2026Updated 3 months ago
- Multi-Organ Foundation Model for Universal Ultrasound Image Segmentation with Task Prompt and Anatomical Prior☆15Sep 30, 2024Updated last year
- 目标检测开源代码☆14Sep 27, 2018Updated 7 years ago
- A modular management and configuration framework for distributed real-time applications in a TSN-based network☆11Sep 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A book for autonomous driving☆29Aug 27, 2024Updated 2 years ago
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 3 years ago
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆13Sep 12, 2023Updated 3 years ago
- Helm Chart to deploy Private Ethereum Network☆18May 17, 2018Updated 8 years ago
- ☆14Aug 14, 2023Updated 3 years ago
- 海康威视网络录像机（NVR）和网络摄像机（IPC）的封装类☆17Jun 9, 2020Updated 6 years ago
- ☆15Dec 25, 2016Updated 9 years ago
- CyclicSim: Different Variants of Cyclic Shapers in TSN☆14Jul 31, 2025Updated last year
- ☆11Sep 26, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Linux截图(原始代码从Taobao的TMTS项目导入)☆14Aug 16, 2012Updated 14 years ago
- 使用leaferjs tensorflowjs. 对 canvas 绘制的图片进行分类识别. 支持替换成自己训练的模型。 欢迎 star☆10Aug 21, 2023Updated 3 years ago
- Code for paper ''Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging''☆12Nov 8, 2020Updated 5 years ago
- Contains configuration files and scripts to perform Time-Sensitive Networking tests on a hardware testbed. Specifically the IEEE 802.1CB …☆13Jun 7, 2022Updated 4 years ago
- Code for paper "Locally Distributed Deep Learning Inference on Edge Device Clusters"☆15Jul 22, 2026Updated last month
- ☆42Jun 25, 2020Updated 6 years ago
- This repo solves The Knapsack problem with the genetic algorithms.☆15Dec 18, 2018Updated 7 years ago
- Freehand ultrasound without external trackers☆42Apr 18, 2025Updated last year
- Python Binding for realcugan-ncnn-vulkan with PyBind11☆12Dec 30, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Text detection network psenet deployed by libtorch and Qt.☆14May 21, 2020Updated 6 years ago
- https://github.com/shouxieai/hard_decode_trt windows编译版本☆13Sep 8, 2022Updated 4 years ago
- ☆17Apr 9, 2026Updated 5 months ago
- Motion-Aware Optical Camera Communication with Event Cameras (arxiv: https://arxiv.org/pdf/2412.00816)☆17May 16, 2025Updated last year
- GUI for MICCAI 2019 "Interactive deep editing framework for medical image segmentation" (One-click medical image segmentation tool!)☆12Jun 5, 2019Updated 7 years ago
- FreeCAD Workbench for URDF & SDF and Gazebo☆14Nov 21, 2019Updated 6 years ago
- ☆14Dec 9, 2021Updated 4 years ago