modelbox-ai / modelbox
A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用,支持GPU,NPU加速。
☆152Updated 10 months ago
Alternatives and similar repositories for modelbox:
Users that are interested in modelbox are comparing it to the libraries listed below
- CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…☆51Updated 3 weeks ago
- ☆40Updated 9 months ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆105Updated 2 weeks ago
- easy development kit☆11Updated 2 years ago
- Examples for SophonSDK☆105Updated 2 years ago
- Serving Inside Pytorch☆160Updated this week
- nndeploy is an end-to-end model inference and deployment framework. It aims to provide users with a powerful, easy-to-use, high-performan…☆722Updated 2 weeks ago
- ☆82Updated 8 months ago
- Run generative AI models in sophgo BM1684X☆196Updated this week
- ☆77Updated last year
- Gstreamer-Cambricon-SDK☆15Updated 3 years ago
- Compare multiple optimization methods on triton to imporve model service performance☆50Updated last year
- ☆33Updated last year
- Guide to deploying deep-learning inference networks and deep vision primitives on Sophon TPU.☆35Updated last year
- ☆258Updated 2 weeks ago
- YOLOv5 in PyTorch > ONNX > CoreML > TFLite☆183Updated 2 years ago
- ☆196Updated 9 months ago
- ☆120Updated last year
- ⚡️ Using NNIE as simple as using ncnn ⚡️☆186Updated 3 years ago
- An onnx-based quantitation tool.☆71Updated last year
- Explore LLM model deployment based on AXera's AI chips☆100Updated 3 weeks ago
- ☆112Updated last year
- ☆245Updated 3 months ago
- Large Language Model Onnx Inference Framework☆32Updated 3 months ago
- TensorRT+YOLO系列的 多路 多卡 多实例 并行视频分析处理案例☆274Updated 2 months ago
- ncnn和pnnx格式编辑器☆132Updated 6 months ago
- async inference for machine learning model☆26Updated 2 years ago
- rknn inference☆44Updated 3 years ago
- llm deploy project based onnx.☆36Updated 6 months ago