modelbox-ai / modelbox
A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用,支持GPU,NPU加速。
☆148Updated 9 months ago
Alternatives and similar repositories for modelbox:
Users that are interested in modelbox are comparing it to the libraries listed below
- ☆38Updated 8 months ago
- Examples for SophonSDK☆106Updated 2 years ago
- ☆95Updated last week
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆75Updated 7 months ago
- Run generative AI models in sophgo BM1684X☆178Updated this week
- ☆252Updated last month
- Serving Inside Pytorch☆155Updated this week
- Compare multiple optimization methods on triton to imporve model service performance☆50Updated last year
- llm deploy project based onnx.☆31Updated 5 months ago
- C++开发的视频行为分析系统v4版本☆160Updated this week
- ☆17Updated last year
- ncnn和pnnx格式编辑器☆130Updated 5 months ago
- Large Language Model Onnx Inference Framework☆31Updated last month
- ☆120Updated last year
- ☆10Updated 7 months ago
- ☆33Updated last year
- OneFlow->ONNX☆42Updated last year
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆81Updated this week
- Tengine Convert Tool supports converting multi framworks' models into tmfile that suitable for Tengine-Lite AI framework.☆92Updated 3 years ago
- ncnn is a high-performance neural network inference framework optimized for the mobile platform☆115Updated this week
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆500Updated 4 months ago
- Guide to deploying deep-learning inference networks and deep vision primitives on Sophon TPU.☆35Updated last year
- easy development kit☆11Updated last year
- Samples code for world class Artificial Intelligence SoCs for computer vision applications.☆243Updated this week
- stable diffusion using mnn☆65Updated last year
- This project provides simple code and demonstrates how to use the TensorRT C++ API and ONNX to deploy PaddleOCR text recognition model.☆41Updated 2 years ago
- PaddlePaddle Developer Community☆98Updated this week
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆41Updated last year
- CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…☆49Updated last year