quic / ai-engine-direct-helperLinks
QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime SDK APIs into a set of simplified interfaces for running models on the NPU/HTP.
☆59Updated this week
Alternatives and similar repositories for ai-engine-direct-helper
Users that are interested in ai-engine-direct-helper are comparing it to the libraries listed below
Sorting:
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆77Updated 3 weeks ago
- ☆149Updated last month
- ☆17Updated last year
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆27Updated 3 weeks ago
- A Toolkit to Help Optimize Large Onnx Model☆157Updated last year
- VeriSilicon Tensor Interface Module☆236Updated 7 months ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆188Updated last year
- MegEngine到其他框架的转换器☆70Updated 2 years ago
- Fork of https://source.codeaurora.org/quic/hexagon_nn/nnlib☆58Updated 2 years ago
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆31Updated 2 years ago
- Tencent NCNN with added CUDA support☆69Updated 4 years ago
- Large Language Model Onnx Inference Framework☆36Updated 6 months ago
- arm-neon☆92Updated last year
- ☆41Updated 2 years ago
- Run Chinese MobileBert model on SNPE.☆15Updated 2 years ago
- ☆97Updated 4 years ago
- Common libraries for PPL projects☆29Updated 4 months ago
- A simple tutorial of SNPE.☆177Updated 2 years ago
- ☆37Updated 9 months ago
- Offline Quantization Tools for Deploy.☆132Updated last year
- Efficient operation implementation based on the Cambricon Machine Learning Unit (MLU) .☆125Updated last week
- A converter for llama2.c legacy models to ncnn models.☆81Updated last year
- LLM inference in C/C++☆44Updated this week
- symmetric int8 gemm☆66Updated 5 years ago
- DDK for Rockchip NPU☆65Updated 4 years ago
- stable diffusion using mnn☆66Updated last year
- Qualcomm Hexagon NN Offload Framework☆43Updated 4 years ago
- llm deploy project based onnx.☆42Updated 9 months ago
- A set of examples around MegEngine☆31Updated last year
- A Toolkit to Help Optimize Onnx Model☆188Updated last week