AXERA-TECH / ax-llmLinks
Explore LLM model deployment based on AXera's AI chips
☆109Updated 2 weeks ago
Alternatives and similar repositories for ax-llm
Users that are interested in ax-llm are comparing it to the libraries listed below
Sorting:
- The Pipeline example based on AXear-Pi (AX620A) , AXera-Pi Pro (AX650N) and AXera-Pi Zero (AX620Q) shows the software development skill…☆5Updated last week
- Samples code for world class Artificial Intelligence SoCs for computer vision applications.☆261Updated 4 months ago
- ☆23Updated 2 years ago
- Run generative AI models in sophgo BM1684X/BM1688☆230Updated last week
- linux bsp app & sample for axpi (ax620a)☆35Updated 2 years ago
- llm deploy project based onnx.☆42Updated 9 months ago
- OpenAI Whisper demo on Axera☆12Updated 3 weeks ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- Large Language Model Onnx Inference Framework☆36Updated 6 months ago
- ☆42Updated last year
- DDK for Rockchip NPU☆65Updated 4 years ago
- YOLOP with ONNXRuntime C++/MNN/TNN/NCNN☆9Updated 3 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- The docs repository of Pulsar2 which is AXera's SoC 2rd AI toolchain. Such as AX650A, AX650N☆15Updated last month
- ☆22Updated last year
- stable diffusion using mnn☆66Updated last year
- the python api for axengine runtime☆17Updated 2 months ago
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆48Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆76Updated 3 weeks ago
- A Toolkit to Help Optimize Large Onnx Model☆157Updated last year
- ggml学习笔记,ggml是一个机器学习的推理框架☆17Updated last year
- A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用,支持GPU,…☆156Updated last year
- ☆27Updated last month
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆81Updated last year
- ☆16Updated last year
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆80Updated 3 years ago
- ☆77Updated last year
- an example of segment-anything infer by ncnn☆123Updated 2 years ago
- ☆124Updated last year
- Zhouyi model zoo☆101Updated last month