chraac / llama-cpp-qnn-builderLinks
☆11Updated last week
Alternatives and similar repositories for llama-cpp-qnn-builder
Users that are interested in llama-cpp-qnn-builder are comparing it to the libraries listed below
Sorting:
- LLM inference in C/C++☆48Updated this week
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆35Updated 6 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆90Updated this week
- Demonstration of running a native LLM on Android device.☆226Updated this week
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆111Updated last week
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆369Updated last week
- llm-export can export llm model to onnx.☆343Updated 3 months ago
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆89Updated last year
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆231Updated last year
- Run generative AI models in sophgo BM1684X/BM1688☆266Updated 2 weeks ago
- Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) an…☆915Updated last week
- llm deploy project based onnx.☆49Updated last year
- ncnn android yolov8 realtime detection, segmentation, pose estimation, classification and obb☆169Updated 3 weeks ago
- A repo for llm on ncnn☆189Updated last week
- Explore LLM model deployment based on AXera's AI chips☆139Updated this week
- ☆1,232Updated 2 months ago
- stable diffusion using mnn☆67Updated 2 years ago
- ncnn android paddle ocr v5☆145Updated 3 weeks ago
- Port of Facebook's LLaMA model in C/C++☆108Updated last week
- Run Large Language Models on RK3588 with GPU-acceleration☆124Updated 2 years ago
- Port of Facebook's LLaMA model in C/C++☆67Updated 9 months ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆428Updated this week
- Yolov12 model supports android deployment.☆138Updated 7 months ago
- A converter for llama2.c legacy models to ncnn models.☆79Updated 2 years ago
- Use ncnn model of yolo11 without magic operation☆20Updated last year
- Inference RWKV with multiple supported backends.☆77Updated this week
- A Android Library for YOLOv5/YOLOv7/YOLOv8 Detection and Pose Inference Based on NCNN☆58Updated last year
- PyTorch Neural Network eXchange☆675Updated last week
- ☆181Updated 2 weeks ago
- Large Language Model Onnx Inference Framework☆36Updated 2 months ago