modelbox-ai / modelboxLinks
A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，NPU加速。
☆160Updated last year
Alternatives and similar repositories for modelbox
Users that are interested in modelbox are comparing it to the libraries listed below
Sorting:
- ☆44Updated last year
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆129Updated 2 weeks ago
- Run generative AI models in sophgo BM1684X/BM1688☆258Updated last week
- Examples for SophonSDK☆107Updated 3 years ago
- DeepSparkHub selects hundreds of application algorithms and models, covering various fields of AI and general-purpose computing, to suppo…☆69Updated last week
- Serving Inside Pytorch☆167Updated 2 weeks ago
- CNStream is a streaming framework for building Cambricon machine learning pipelines http://forum.cambricon.com https://gitee.com/Solu…☆54Updated 9 months ago
- autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码， 最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …☆29Updated 4 years ago
- ☆36Updated last year
- ☆268Updated last month
- The DeepSpark open platform selects hundreds of open source application algorithms and models that are deeply coupled with industrial app…☆45Updated this week
- llm deploy project based onnx.☆47Updated last year
- ☆19Updated last year
- ☆149Updated 2 years ago
- The Pipeline example based on AX650N/AX8850 shows the software development skills of Image Processing, NPU, Codec, and Display modules, …☆12Updated 4 months ago
- Explore LLM model deployment based on AXera's AI chips☆131Updated 2 weeks ago
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- Gstreamer-Cambricon-SDK☆15Updated 3 years ago
- a simple lightweight large language model pipeline framework.☆28Updated 8 months ago
- Large Language Model Onnx Inference Framework☆36Updated last month
- ncnn和pnnx格式编辑器☆137Updated last year
- a plugin-oriented framework for video structured. 国产程序员请加微信zhzhi78拉群交流。☆18Updated last year
- Chinese license plate recognition☆29Updated 4 years ago
- easy development kit☆11Updated 8 months ago
- stable diffusion using mnn☆67Updated 2 years ago
- High Performan Ai Model Web Server. Mainly support computer vision model. Quickly establish your own ai-model server. https://github.com/…☆45Updated 7 months ago
- ☆109Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆51Updated 2 years ago
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆101Updated last week