modelbox-ai / modelbox
A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，NPU加速。
☆139Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for modelbox
- ☆35Updated 4 months ago
- CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…☆46Updated last year
- ☆76Updated 3 weeks ago
- Examples for SophonSDK☆104Updated 2 years ago
- ☆242Updated last week
- Run generative AI models in sophgo BM1684X☆126Updated this week
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆71Updated this week
- ☆68Updated 3 months ago
- Explore LLM model deployment based on AXera's AI chips☆54Updated last week
- run ChatGLM2-6B in BM1684X☆48Updated 8 months ago
- TensorRT encapsulation, learn, rewrite, practice.☆25Updated 2 years ago
- OneFlow->ONNX☆42Updated last year
- b站上的课程☆70Updated last year
- Serving Inside Pytorch☆145Updated this week
- Integrated MLU-accelerated video processing into ffmpeg on Ubuntu/Centos☆51Updated last month
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆494Updated 3 weeks ago
- easy development kit☆10Updated last year
- ncnn和pnnx格式编辑器☆125Updated last month
- nndeploy是一款模型端到端部署框架。以多端推理以及基于有向无环图模型部署为基础，致力为用户提供跨平台、简单易用、高性能的模型部署体验。☆636Updated this week
- async inference for machine learning model☆26Updated 2 years ago
- ☆110Updated last year
- Compare multiple optimization methods on triton to imporve model service performance☆46Updated 10 months ago
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆94Updated 3 years ago
- autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码， 最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …☆27Updated 3 years ago
- rknn inference☆42Updated 2 years ago
- Samples code for world class Artificial Intelligence SoCs for computer vision applications.☆219Updated last week
- ☆236Updated this week
- DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…☆57Updated this week
- ☆96Updated 3 years ago