A curated list of awesome inference deployment framework of artificial intelligence (AI) models. OpenVINO, TensorRT, MediaPipe, TensorFlow Lite, TensorFlow Serving, ONNX Runtime, LibTorch, NCNN, TNN, MNN, TVM, MACE, Paddle Lite, MegEngine Lite, OpenPPL, Bolt, ExecuTorch.
☆75May 3, 2024Updated 2 years ago
Alternatives and similar repositories for Model-Inference-Deployment
Users that are interested in Model-Inference-Deployment are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Study notes in Chinese based on Self-Driving Cars (Prof. Andreas Geiger, University of Tübingen)☆12Aug 4, 2022Updated 3 years ago
- Implementation of some model inference based on onnxruntime using python☆13Oct 12, 2023Updated 2 years ago
- Repository for submodules containing code for MMAR 2023 "Detection-segmentation convolutional neural network for autonomous vehicle perc…☆28Jun 19, 2023Updated 3 years ago
- Collection of blogs on AI development☆23Nov 13, 2024Updated last year
- [MobiCom 24] Adaptive DNN inference under memory constraints☆57Jan 22, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- AutoregressModel-AE_VAD_CVPR2019 (code reimplemetation)☆12Oct 10, 2020Updated 5 years ago
- copy and update the mobilenetv2_ssd from [mmdetect](https://github.com/open-mmlab/mmdetection)☆14Dec 17, 2019Updated 6 years ago
- Simulating the quantum approximate optimization algorithm with Matlab☆12Aug 26, 2021Updated 4 years ago
- Interface for inertial(oxts2000) and lidar(velodyne hdl-32e)☆10Mar 8, 2018Updated 8 years ago
- Final year research project to design a programmable virtual switch based on the specifications of a TSN to be implemented on a TSN netwo…☆13Nov 17, 2020Updated 5 years ago
- learning-cuda-trt☆121Feb 23, 2023Updated 3 years ago
- CoPur: Certifiably Robust Collaborative Inference via Feature Purification (NeurIPS 2022)☆11Dec 7, 2022Updated 3 years ago
- Master Thesis☆11Jan 28, 2023Updated 3 years ago
- A memcached client library for C/C++. Best suited to yrmcds.☆18May 21, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is a release code of the paper "Fuzzy Attention Neural Network to Tackle Discontinuity in Airway Segmentation"☆17May 5, 2023Updated 3 years ago
- Implementation based on Probabilstic Robotics by Thrun et. al.☆10Mar 11, 2017Updated 9 years ago
- ☆14Aug 14, 2023Updated 2 years ago
- Demo app with Loguru logging, async middleware to generate X-request-Id. Works with Gunicorn or Uvicorn, and is safe to use with async/th…☆10Feb 2, 2022Updated 4 years ago
- ☆16Jul 4, 2021Updated 5 years ago
- solving knapsack problem with n items with GA(genetic algorithm)☆10May 17, 2026Updated 2 months ago
- 海康威视网络录像机（NVR）和网络摄像机（IPC）的封装类☆17Jun 9, 2020Updated 6 years ago
- Accelerating GOT-OCRv2 with VLLM☆10Nov 15, 2024Updated last year
- 2019-2020春季学期 清华大学电子工程系 研究生课程 模式识别☆10Nov 27, 2020Updated 5 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- CyclicSim: Different Variants of Cyclic Shapers in TSN☆13Jul 31, 2025Updated 11 months ago
- [WACV'26] ForestSplats: Deformable transient field for Gaussian Splatting in the Wild☆18Mar 10, 2026Updated 4 months ago
- ☆11Sep 26, 2024Updated last year
- Linux截图(原始代码从Taobao的TMTS项目导入)☆14Aug 16, 2012Updated 13 years ago
- [ICLR 2025] OccProphet: Pushing Efficiency Frontier of Camera-Only 4D Occupancy Forecasting with Observer-Forecaster-Refiner Framework☆60Mar 18, 2026Updated 4 months ago
- 使用leaferjs tensorflowjs. 对 canvas 绘制的图片进行分类识别. 支持替换成自己训练的模型。 欢迎 star☆10Aug 21, 2023Updated 2 years ago
- Code for paper "Locally Distributed Deep Learning Inference on Edge Device Clusters"☆15Jun 17, 2026Updated last month
- ☆26Jan 28, 2024Updated 2 years ago
- Freehand ultrasound without external trackers☆42Apr 18, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Text detection network psenet deployed by libtorch and Qt.☆14May 21, 2020Updated 6 years ago
- https://github.com/shouxieai/hard_decode_trt windows编译版本☆13Sep 8, 2022Updated 3 years ago
- ☆14Nov 29, 2022Updated 3 years ago
- Implementation of the paper "A survey on attention mechanisms for medical applications: are we moving towards better algorithms?" by Tiag…☆13Sep 25, 2022Updated 3 years ago
- 基于Tornado、Redis、UDP多播的分布式聊天室☆17May 29, 2013Updated 13 years ago
- FreeCAD Workbench for URDF & SDF and Gazebo☆14Nov 21, 2019Updated 6 years ago
- GUI for MICCAI 2019 "Interactive deep editing framework for medical image segmentation" (One-click medical image segmentation tool!)☆12Jun 5, 2019Updated 7 years ago