quic / ai-engine-direct-helperLinks
QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime SDK APIs into a set of simplified interfaces for running models on the NPU/HTP.
☆96Updated this week
Alternatives and similar repositories for ai-engine-direct-helper
Users that are interested in ai-engine-direct-helper are comparing it to the libraries listed below
Sorting:
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆35Updated 5 months ago
- ☆168Updated last week
- VeriSilicon Tensor Interface Module☆243Updated 3 weeks ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆88Updated 2 weeks ago
- stable diffusion using mnn☆67Updated 2 years ago
- A Toolkit to Help Optimize Onnx Model☆276Updated last week
- Run Chinese MobileBert model on SNPE.☆15Updated 2 years ago
- Acuity Model Zoo☆150Updated 2 months ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆192Updated 2 years ago
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆350Updated this week
- Large Language Model Onnx Inference Framework☆36Updated 3 weeks ago
- A Toolkit to Help Optimize Large Onnx Model☆162Updated last month
- LLM inference in C/C++☆48Updated this week
- llm deploy project based onnx.☆47Updated last year
- ☆42Updated 3 years ago
- Fork of https://source.codeaurora.org/quic/hexagon_nn/nnlib☆58Updated 2 years ago
- A converter for llama2.c legacy models to ncnn models.☆80Updated 2 years ago
- Tencent NCNN with added CUDA support☆71Updated 4 years ago
- MediaTek's TFLite delegate☆49Updated last week
- NeRF in NCNN with c++ & vulkan☆68Updated 2 years ago
- symmetric int8 gemm☆67Updated 5 years ago
- MegEngine到其他框架的转换器☆69Updated 2 years ago
- A simple tutorial of SNPE.☆182Updated 2 years ago
- Serving Inside Pytorch☆166Updated last week
- DDK for Rockchip NPU☆69Updated 4 years ago
- Explore LLM model deployment based on AXera's AI chips☆131Updated last week
- ☆33Updated last year
- Common libraries for PPL projects☆30Updated 9 months ago
- C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ON…☆299Updated 3 years ago
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆106Updated last week