A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆75May 3, 2024Updated 2 years ago
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Repository for submodules containing code for MMAR 2023 "Detection-segmentation convolutional neural network for autonomous vehicle perc…☆28Jun 19, 2023Updated 3 years ago
- Collection of blogs on AI development☆23Nov 13, 2024Updated last year
- [MobiCom 24] Adaptive DNN inference under memory constraints☆59Jan 22, 2025Updated last year
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆14Dec 17, 2019Updated 6 years ago
- Simulating the quantum approximate optimization algorithm with Matlab☆12Aug 26, 2021Updated 5 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Final year research project to design a programmable virtual switch based on the specifications of a TSN to be implemented on a TSN netwo…☆13Nov 17, 2020Updated 5 years ago
- learning-cuda-trt☆123Feb 23, 2023Updated 3 years ago
- ☆10Dec 7, 2022Updated 3 years ago
- Master Thesis☆11Jan 28, 2023Updated 3 years ago
- Resources of our survey paper "Optimizing Edge AI: A Comprehensive Survey on Data, Model, and System Strategies"☆119Jun 10, 2026Updated 4 months ago
- A modular management and configuration framework for distributed real-time applications in a TSN-based network☆11Sep 5, 2024Updated 2 years ago
- A book for autonomous driving☆30Aug 27, 2024Updated 2 years ago
- 挑战杯rk板端代码，gstreamer mpp硬解码，以及推理模型的rknn部署☆13Sep 12, 2023Updated 3 years ago
- ☆11Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Implementation based on Probabilstic Robotics by Thrun et. al.☆10Mar 11, 2017Updated 9 years ago
- ☆14Aug 14, 2023Updated 3 years ago
- solving knapsack problem with n items with GA(genetic algorithm)☆10May 17, 2026Updated 4 months ago
- ☆15Dec 25, 2016Updated 9 years ago
- Testing tools for Oracle Forms☆16Oct 23, 2025Updated 11 months ago
- Transfer Learning for Survival Analysis via Efficient L2,1-norm Regularized Cox Regression☆13Sep 18, 2016Updated 10 years ago
- CyclicSim: Different Variants of Cyclic Shapers in TSN☆14Jul 31, 2025Updated last year
- Kálmán filter based ROS 1 / ROS 2 node (geometry_msgs/pose, sensor_msgs/imu)☆14Jun 18, 2026Updated 3 months ago
- Linux截图(原始代码从Taobao的TMTS项目导入)☆14Aug 16, 2012Updated 14 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- [ICLR 2025] OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework☆60Mar 18, 2026Updated 6 months ago
- Code for paper "Locally Distributed Deep Learning Inference on Edge Device Clusters"☆17Jul 22, 2026Updated 2 months ago
- ☆14Sep 2, 2024Updated 2 years ago
- Discover the perfect harmony of tunes and movies!☆10Aug 17, 2023Updated 3 years ago
- ☆42Jun 25, 2020Updated 6 years ago
- Freehand ultrasound without external trackers☆43Apr 18, 2025Updated last year
- Python Binding for realcugan-ncnn-vulkan with PyBind11☆12Dec 30, 2023Updated 2 years ago
- https://github.com/shouxieai/hard_decode_trt windows编译版本☆13Sep 8, 2022Updated 4 years ago
- FFBNET : LIGHTWEIGHT BACKBONE FOR OBJECT DETECTION BASED FEATURE FUSION BLOCK☆13May 16, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Motion-Aware Optical Camera Communication with Event Cameras (arxiv: https://arxiv.org/pdf/2412.00816)☆17May 16, 2025Updated last year
- GUI for MICCAI 2019 "Interactive deep editing framework for medical image segmentation" (One-click medical image segmentation tool!)☆13Jun 5, 2019Updated 7 years ago
- FreeCAD Workbench for URDF & SDF and Gazebo☆14Nov 21, 2019Updated 6 years ago
- ☆14Dec 9, 2021Updated 4 years ago
- StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth prediction model in pytorch. ECCV2018☆12Aug 14, 2019Updated 7 years ago
- Decompiler for Oracle FMX files version 6☆18Nov 28, 2023Updated 2 years ago
- Framework that supports federated split learning with multiple hops that enables pipeline parallelism.☆16Jun 17, 2026Updated 3 months ago