modelbox-ai / modelbox
A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，NPU加速。
☆144Updated 7 months ago
Alternatives and similar repositories for modelbox:
Users that are interested in modelbox are comparing it to the libraries listed below
- ☆37Updated 6 months ago
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆78Updated last week
- run ChatGLM2-6B in BM1684X☆49Updated 10 months ago
- ☆89Updated last week
- Compare multiple optimization methods on triton to imporve model service performance☆48Updated last year
- Explore LLM model deployment based on AXera's AI chips☆71Updated last month
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆92Updated 3 years ago
- Serving Inside Pytorch☆151Updated this week
- autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码， 最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …☆27Updated 3 years ago
- ☆74Updated 5 months ago
- ☆97Updated 3 years ago
- Examples for SophonSDK☆105Updated 2 years ago
- ☆246Updated 2 weeks ago
- Convert the official paddleocr model to a deployable model on RK1126☆34Updated 2 years ago
- ☆23Updated 9 months ago
- ☆17Updated last year
- A Toolkit to Help Optimize Onnx Model☆106Updated this week
- CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…☆49Updated last year
- Run generative AI models in sophgo BM1684X☆155Updated this week
- ☆116Updated last year
- ☆32Updated 11 months ago
- async inference for machine learning model☆26Updated 2 years ago
- ncnn和pnnx格式编辑器☆129Updated 3 months ago
- ☆10Updated 6 months ago
- simplify >2GB large onnx model☆51Updated 2 months ago
- rknn inference☆43Updated 2 years ago
- ☆34Updated 7 months ago
- stable diffusion using mnn☆65Updated last year
- OneFlow->ONNX☆42Updated last year
- ☆77Updated last year