midea-ai / Aidget
Ai edge toolbox,专门面向边端设备尤其是嵌入式RTOS平台,AI模型部署工具链,包括模型推理引擎和模型压缩工具
☆147Updated last year
Alternatives and similar repositories for Aidget:
Users that are interested in Aidget are comparing it to the libraries listed below
- 【深度学习模型部署框架】支持tf/torch/trt/trtllm/vllm以及更多nn框架,支持dynamic batching、streaming模式,支 持python/c++双语言,可限制,可拓展,高性能。帮助用户快速地将模型部署到线上,并通过http/rpc接口方式…☆153Updated 2 weeks ago
- 【高性能OpenAI LLM服务】通过GPRS+TensorRT-LLM+Tokenizers.cpp实现纯C++版高性能OpenAI LLM服务,支持chat和function call模式,支持ai agent,支持分布式多卡推理,支持多模态,支持gradio聊天界面。☆91Updated this week
- 模型部署白皮书(CUDA|ONNX|TensorRT|C++)🚀🚀🚀☆167Updated 4 months ago
- A repo that uses TensorRT to deploy wll-trained models.Support RTDETR,YOLO-NAS,YOLOV5,YOLOV6,YOLOV7,YOLOV8,YOLOX.☆105Updated last year
- 🚀 Do not need libtorch, pure C++ TensorRT deploys SOLOv2 etc, which can be quickly ported to NX/TX2.☆42Updated 2 years ago
- YOLOv5 pruning on COCO Dataset☆82Updated last year
- TengineGst is a streaming media analytics framework, based on GStreamer multimedia framework, for creating varied complex media analytics…☆57Updated 3 years ago
- 使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力☆136Updated 6 months ago
- A implementation of centerloss in multi_box_loss☆62Updated 5 years ago
- QAT(quantize aware training) for classification with MQBench☆28Updated 3 years ago
- SegmentAnything-OnnxRunner is an example using Meta AI Research's SAM onnx model in C++.The encoder and decoder of SAM are decoupled in t…☆93Updated last year
- 目标检测,采用yolov8作为基准模型,数据集采用VisDrone2019,带有自己的改进策略☆65Updated 6 months ago
- Haohanyh-HAMOS-ProjectX Hi3861+华为云IoTDA+Android APP......☆31Updated 2 years ago
- Multi-Branch Auxiliary Fusion YOLO☆92Updated last month
- ☆130Updated last year
- ☆89Updated last week
- Examples for SophonSDK☆105Updated 2 years ago
- ☆74Updated 5 months ago
- An open source task scheduling library ASRT (Async Runtime) written in modern C++ tailored for embedded linux systems.☆98Updated 5 months ago
- Detect known and unknown objects in the open world(具有区分已知与未知能力的全新检测器))☆85Updated last year
- ☆37Updated 6 months ago
- Algorithm acceleration landing framework, let you complete the development of algorithm at low cost.eg: Facedetect, FaceLandmark..☆68Updated 3 years ago
- TVM Documentation in Chinese Simplified / TVM 中文文档☆801Updated 2 weeks ago
- 本项目使用YOLOv4模型,并在对数字信号灯进行数字识别时采用opencv算法。☆98Updated last year
- Chat-Style-Bot是一个聊天风格模仿大语言模型,通过分析和学习微信聊天记录,可模仿你的说话风格(口头禅等),并可接入微信和你的朋友们自动聊天。Chat-Style-Bot is a chat style imitating llm. By analyzing an…☆75Updated 6 months ago
- YOLOv5 in PyTorch > ONNX > CoreML > TFLite☆181Updated 2 years ago
- 🔥 (yolov3 yolov4 yolov5 unet ...)A mini pytorch inference framework which inspired from darknet.☆739Updated last year
- An ultra fast tiny model for lane detection, using onnx_parser, TensorRTAPI, torch2trt to accelerate. our model support for int8, dynamic…☆120Updated 3 years ago
- Support mixed-precsion inference with vllm☆79Updated 2 weeks ago
- 《AI嵌入式系统——算法优化与实现》软件工具、例程及教学辅助材料☆69Updated 8 months ago