AXERA-TECH / ax-llmLinks
Explore LLM model deployment based on AXera's AI chips
☆104Updated 2 weeks ago
Alternatives and similar repositories for ax-llm
Users that are interested in ax-llm are comparing it to the libraries listed below
Sorting:
- Samples code for world class Artificial Intelligence SoCs for computer vision applications.☆258Updated 2 months ago
- ☆23Updated last year
- linux bsp app & sample for axpi (ax620a)☆34Updated 2 years ago
- Run generative AI models in sophgo BM1684X/BM1688☆218Updated this week
- ☆41Updated 11 months ago
- ☆22Updated last year
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆45Updated 3 years ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- DDK for Rockchip NPU☆64Updated 4 years ago
- ☆77Updated last year
- The docs repository of Pulsar2 which is AXera's SoC 2rd AI toolchain. Such as AX650A, AX650N☆15Updated 4 months ago
- Large Language Model Onnx Inference Framework☆35Updated 5 months ago
- ☆113Updated last week
- llm deploy project based onnx.☆42Updated 8 months ago
- ☆81Updated last year
- an example of segment-anything infer by ncnn☆121Updated 2 years ago
- the python api for axengine runtime☆16Updated 3 weeks ago
- A converter for llama2.c legacy models to ncnn models.☆81Updated last year
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆47Updated last year
- 使用NCNN推理框架和ByteTrack目标跟踪框架,对网络、文件流URL进行实时性视频推理,而UI界面则由Qt框架实现☆21Updated 8 months ago
- ncnn benchmark on various single board computers☆160Updated last year
- ppstructure deploy by ncnn☆32Updated 11 months ago
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU☆12Updated 3 weeks ago
- MeloTTS demo on Axera☆8Updated 2 months ago
- A collection of pre-compiled, state-of-the-art models in the AXera‘s format☆22Updated 2 years ago
- A Toolkit to Help Optimize Large Onnx Model☆157Updated last year
- A keras h5df to ncnn model converter☆89Updated 2 years ago
- ☆124Updated last year
- An onnx-based quantitation tool.☆71Updated last year
- Inference TinyLlama models on ncnn☆24Updated last year