modelbox-ai / modelbox
A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用,支持GPU,NPU加速。
☆154Updated 11 months ago
Alternatives and similar repositories for modelbox:
Users that are interested in modelbox are comparing it to the libraries listed below
- ☆106Updated last week
- ☆41Updated 10 months ago
- Examples for SophonSDK☆105Updated 2 years ago
- CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…☆51Updated last month
- The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…☆42Updated last month
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆83Updated last week
- ☆84Updated 9 months ago
- DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…☆63Updated this week
- Run generative AI models in sophgo BM1684X/BM1688☆207Updated this week
- Compare multiple optimization methods on triton to imporve model service performance☆50Updated last year
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆93Updated 3 years ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆258Updated last month
- nndeploy is an end-to-end model inference and deployment framework. It aims to provide users with a powerful, easy-to-use, high-performan…☆759Updated this week
- ☆113Updated last year
- easy development kit☆11Updated 3 weeks ago
- ☆77Updated last year
- OneFlow->ONNX☆43Updated 2 years ago
- a simple lightweight large language model pipeline framework.☆24Updated 2 weeks ago
- DDK for Rockchip NPU☆61Updated 4 years ago
- ☆196Updated 10 months ago
- Serving Inside Pytorch☆160Updated this week
- Samples code for world class Artificial Intelligence SoCs for computer vision applications.☆254Updated last month
- ncnn和pnnx格式编辑器☆133Updated 7 months ago
- Gstreamer-Cambricon-SDK☆15Updated 3 years ago
- Explore LLM model deployment based on AXera's AI chips☆102Updated this week
- An onnx-based quantitation tool.☆71Updated last year
- rknn inference☆44Updated 3 years ago
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆484Updated 6 months ago
- ☆122Updated last year