quic / ai-engine-direct-helperLinks
QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime SDK APIs into a set of simplified interfaces for running models on the NPU/HTP.
☆77Updated last week
Alternatives and similar repositories for ai-engine-direct-helper
Users that are interested in ai-engine-direct-helper are comparing it to the libraries listed below
Sorting:
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆34Updated 3 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆84Updated last week
- ☆160Updated 3 months ago
- VeriSilicon Tensor Interface Module☆237Updated this week
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆189Updated 2 years ago
- DDK for Rockchip NPU☆67Updated 4 years ago
- stable diffusion using mnn☆67Updated 2 years ago
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆311Updated last week
- LLM inference in C/C++☆45Updated last week
- llm deploy project based onnx.☆44Updated last year
- snpe tutorial☆10Updated last year
- Large Language Model Onnx Inference Framework☆36Updated 9 months ago
- A simple tutorial of SNPE.☆179Updated 2 years ago
- A Toolkit to Help Optimize Large Onnx Model☆161Updated last year
- Run Chinese MobileBert model on SNPE.☆15Updated 2 years ago
- A converter for llama2.c legacy models to ncnn models.☆81Updated last year
- ☆41Updated 2 years ago
- Common libraries for PPL projects☆29Updated 7 months ago
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆70Updated 4 months ago
- MegEngine到其他框架的转换器☆70Updated 2 years ago
- Tencent NCNN with added CUDA support☆69Updated 4 years ago
- ☆37Updated last year
- Serving Inside Pytorch☆163Updated 2 weeks ago
- Fork of https://source.codeaurora.org/quic/hexagon_nn/nnlib☆58Updated 2 years ago
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆88Updated last week
- NeRF in NCNN with c++ & vulkan☆68Updated 2 years ago
- ☆98Updated 4 years ago
- Tensorflow Lite external delegate based on TIM-VX☆49Updated 9 months ago
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆35Updated 3 years ago
- Run generative AI models in sophgo BM1684X/BM1688☆248Updated this week