DefTruth / lite.ai.toolkit
🛠 A lite C++ toolkit of awesome AI models, support ONNXRuntime, MNN, TNN, NCNN and TensorRT.
☆3,644Updated last week
Related projects ⓘ
Alternatives and complementary repositories for lite.ai.toolkit
- ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio …☆2,982Updated last month
- TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is …☆4,407Updated 2 weeks ago
- Based on yolo's ultra-lightweight universal target detection algorithm, the calculation amount is only 250mflops, the ncnn model size is…☆2,006Updated 3 years ago
- C++ library based on tensorrt integration☆2,599Updated last year
- Simplify your onnx model☆3,849Updated 2 months ago
- NanoDet-Plus⚡Super fast and lightweight anchor-free object detection model. 🔥Only 980 KB(int8) / 1.8MB (fp16) and run 97FPS on cellphone…☆5,753Updated 3 months ago
- Simple samples for TensorRT programming☆1,510Updated last week
- Implementation of popular deep learning networks with TensorRT network definition API☆6,984Updated 2 weeks ago
- ONNX-TensorRT: TensorRT backend for ONNX☆2,948Updated this week
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,548Updated 7 months ago
- OpenMMLab Model Deployment Framework☆2,764Updated last month
- 🍅 Deploy ncnn on mobile phones. Support Android and iOS. 移动端ncnn部署，支持Android与iOS。☆1,476Updated 2 years ago
- 🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥☆3,123Updated 11 months ago
- 😎 A Collection of Awesome NCNN-based Projects☆711Updated last year
- A newly designed ultra lightweight anchor free target detection algorithm， weight only 250K parameters， reduces the time consumption by …☆774Updated last year
- MNN is a blazing fast, lightweight deep learning framework, battle-tested by business-critical use cases in Alibaba☆8,712Updated last week
- YOLOv8 using TensorRT accelerate !☆1,368Updated 2 weeks ago
- An easy to use PyTorch to TensorRT converter☆4,599Updated 2 months ago
- YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)☆2,097Updated 3 months ago
- PaddleSlim is an open-source library for deep model compression and architecture search.☆1,562Updated this week
- Based on Yolo's low-power, ultra-lightweight universal target detection algorithm, the parameter is only 250k, and the speed of the smar…☆808Updated 9 months ago
- ☆988Updated 7 months ago
- ☆818Updated 10 months ago
- PyTorch Neural Network eXchange☆517Updated 2 weeks ago
- A primitive library for neural network☆1,291Updated this week
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,331Updated this week
- The minimal opencv for Android, iOS, ARM Linux, Windows, Linux, MacOS, HarmonyOS, WebAssembly, watchOS, tvOS, visionOS☆2,532Updated last week
- ncnn is a high-performance neural network inference framework optimized for the mobile platform☆20,436Updated this week
- nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为基础，致力为用户提供跨平台、简单易用、高性能的模型部署体验。☆629Updated this week
- tensorrt for yolo series (YOLOv10,YOLOv9,YOLOv8,YOLOv7,YOLOv6,YOLOX,YOLOv5), nms plugin support☆925Updated 4 months ago