A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆75May 3, 2024Updated 2 years ago
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Study notes in Chinese based on Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)☆12Aug 4, 2022Updated 4 years ago
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 3 years ago
- Collection of blogs on AI development☆23Nov 13, 2024Updated last year
- Wrapper for easier inference for insightface☆11Nov 7, 2023Updated 2 years ago
- 该库用于python获取显卡的信息,列如英特尔,AMD和英伟达☆14May 8, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A collection of awesome Machine Learning software, libraries, Learning Tutorials, documents, books, resources and interesting stuff in …☆31May 17, 2023Updated 3 years ago
- ☆16Mar 24, 2026Updated 7 months ago
- AutoregressModel-AE_VAD_CVPR2019 (code reimplemetation)☆12Oct 10, 2020Updated 6 years ago
- 🟣 Anomaly Detection interview questions and answers to help you prepare for your next machine learning and data science interview in 202…☆10Jan 4, 2026Updated 9 months ago
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆14Dec 17, 2019Updated 6 years ago
- A Visual Studio project demonstrating how to perform object tracking across video frames with YOLOX, ONNX Runtime, and the ByteTrack-Eige…☆12Nov 19, 2023Updated 2 years ago
- learning-cuda-trt☆123Feb 23, 2023Updated 3 years ago
- Agent with Warm Start and Adaptive Dynamic Termination for Plane Localization in 3D Ultrasound☆15Oct 5, 2022Updated 4 years ago
- Master Thesis☆11Jan 28, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- Performance Analysis with Network Calculus and Optimization☆13Sep 14, 2026Updated last month
- Code || Q&A☆11Oct 25, 2018Updated 8 years ago
- ☆10Jan 24, 2025Updated last year
- Final year research project to design a programmable virtual switch based on the specifications of a TSN to be implemented on a TSN netwo…☆13Nov 17, 2020Updated 5 years ago
- Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"☆119Jun 10, 2026Updated 4 months ago
- Interface for inertial(oxts2000) and lidar(velodyne hdl-32e)☆10Mar 8, 2018Updated 8 years ago
- Transfer Learning for Survival Analysis via Efficient L2,1-norm Regularized Cox Regression☆13Sep 18, 2016Updated 10 years ago
- 海康威视网络录像机（NVR）和网络摄像机（IPC）的封装类☆17Jun 9, 2020Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- GUI for MICCAI 2019 "Interactive deep editing framework for medical image segmentation" (One-click medical image segmentation tool!)☆13Jun 5, 2019Updated 7 years ago
- ☆14Sep 2, 2024Updated 2 years ago
- 使用leaferjs tensorflowjs. 对 canvas 绘制的图片进行分类识别. 支持替换成自己训练的模型。 欢迎 star☆10Aug 21, 2023Updated 3 years ago
- 🟣 Feature Engineering interview questions and answers to help you prepare for your next machine learning and data science interview in 2…☆18Jan 4, 2026Updated 9 months ago
- ☆10Dec 17, 2020Updated 5 years ago
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆14Sep 12, 2023Updated 3 years ago
- Text detection network psenet deployed by libtorch and Qt.☆14May 21, 2020Updated 6 years ago
- This project is about the undergraduate thesis, the main idea is about route allocation algorithm.☆11Mar 28, 2020Updated 6 years ago
- https://github.com/shouxieai/hard_decode_trt windows编译版本☆13Sep 8, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆42Jun 25, 2020Updated 6 years ago
- Compare PyTorch models from MATLAB using co-execution☆14Apr 6, 2026Updated 6 months ago
- Additional materials to the paper "Constraint Programming Approaches to Joint Routing and Scheduling in Time-Sensitive Networks"☆10Mar 3, 2021Updated 5 years ago
- ☆13Jul 15, 2026Updated 3 months ago
- Image classifier to help TensorFlow Lite C++ API usage with Bazel.☆12Oct 12, 2021Updated 5 years ago
- Code for paper ''Weakly Supervised Estimation of Shadow Confidence Maps in Fetal Ultrasound Imaging''☆12Nov 8, 2020Updated 5 years ago
- Dockerfiles for cuda on arm64v8 (Jetson TX2)☆11Sep 5, 2017Updated 9 years ago