quic / ai-engine-direct-helperLinks
QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime SDK APIs into a set of simplified interfaces for running models on the NPU/HTP.
☆87Updated last week
Alternatives and similar repositories for ai-engine-direct-helper
Users that are interested in ai-engine-direct-helper are comparing it to the libraries listed below
Sorting:
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆87Updated last month
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆35Updated 4 months ago
- ☆167Updated 2 weeks ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆191Updated 2 years ago
- VeriSilicon Tensor Interface Module☆240Updated last month
- DDK for Rockchip NPU☆68Updated 4 years ago
- A converter for llama2.c legacy models to ncnn models.☆80Updated last year
- Fork of https://source.codeaurora.org/quic/hexagon_nn/nnlib☆58Updated 2 years ago
- Tencent NCNN with added CUDA support☆71Updated 4 years ago
- Common libraries for PPL projects☆30Updated 8 months ago
- Large Language Model Onnx Inference Framework☆36Updated last month
- llm deploy project based onnx.☆47Updated last year
- stable diffusion using mnn☆67Updated 2 years ago
- NeRF in NCNN with c++ & vulkan☆68Updated 2 years ago
- An easy way to run, test, benchmark and tune OpenCL kernel files☆24Updated 2 years ago
- Run Chinese MobileBert model on SNPE.☆15Updated 2 years ago
- MegEngine到其他框架的转换器☆70Updated 2 years ago
- LLM inference in C/C++☆46Updated last week
- ☆41Updated 3 years ago
- Qualcomm Hexagon NN Offload Framework☆43Updated 5 years ago
- symmetric int8 gemm☆67Updated 5 years ago
- YOLOv5在高通AI Engine Direct环境下进行QNN量化,CPU推理的项目☆16Updated last year
- edge/mobile transformer based Vision DNN inference benchmark☆16Updated 3 months ago
- The docs repository of Pulsar2 which is AXera's SoC 2rd AI toolchain. Such as AX650A, AX650N☆15Updated last month
- The Pipeline example based on AX650N/AX8850 shows the software development skills of Image Processing, NPU, Codec, and Display modules, …☆11Updated 3 months ago
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆342Updated 2 weeks ago
- A simple tutorial of SNPE.☆180Updated 2 years ago
- Run generative AI models in sophgo BM1684X/BM1688☆253Updated last week
- ☆41Updated 8 months ago
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆32Updated 3 years ago