quic / ai-engine-direct-helperLinks
QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime SDK APIs into a set of simplified interfaces for running models on the NPU/HTP.
☆64Updated last week
Alternatives and similar repositories for ai-engine-direct-helper
Users that are interested in ai-engine-direct-helper are comparing it to the libraries listed below
Sorting:
- ☆154Updated 2 months ago
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆30Updated last month
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆79Updated last week
- Large Language Model Onnx Inference Framework☆36Updated 7 months ago
- Run Chinese MobileBert model on SNPE.☆15Updated 2 years ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆188Updated 2 years ago
- Fork of https://source.codeaurora.org/quic/hexagon_nn/nnlib☆58Updated 2 years ago
- VeriSilicon Tensor Interface Module☆237Updated 7 months ago
- Tensorflow Lite external delegate based on TIM-VX☆47Updated 7 months ago
- ☆41Updated 2 years ago
- A simple tutorial of SNPE.☆177Updated 2 years ago
- Common libraries for PPL projects☆29Updated 5 months ago
- snpe tutorial☆10Updated last year
- LLM inference in C/C++☆44Updated this week
- DDK for Rockchip NPU☆66Updated 4 years ago
- MegEngine到其他框架的转换器☆70Updated 2 years ago
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆31Updated 2 years ago
- stable diffusion using mnn☆66Updated last year
- A Toolkit to Help Optimize Large Onnx Model☆158Updated last year
- MediaTek's TFLite delegate☆46Updated last year
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆68Updated 3 months ago
- Offline Quantization Tools for Deploy.☆136Updated last year
- ggml学习笔记,ggml是一个机器学习的推理框架☆18Updated last year
- Tencent NCNN with added CUDA support☆69Updated 4 years ago
- llm deploy project based onnx.☆43Updated 10 months ago
- YOLOv5在高通AI Engine Direct环境下进行QNN量化,CPU推理的项目☆14Updated 11 months ago
- symmetric int8 gemm☆66Updated 5 years ago
- arm-neon☆92Updated last year
- ☆17Updated last year
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆34Updated 3 years ago