chraac / llama-cpp-qnn-builderLinks
☆10Updated last week
Alternatives and similar repositories for llama-cpp-qnn-builder
Users that are interested in llama-cpp-qnn-builder are comparing it to the libraries listed below
Sorting:
- LLM inference in C/C++☆46Updated this week
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆35Updated 4 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆87Updated 3 weeks ago
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆223Updated last year
- Demonstration of running a native LLM on Android device.☆195Updated last week
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆338Updated this week
- llm-export can export llm model to onnx.☆328Updated 3 weeks ago
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆86Updated last year
- Run generative AI models in sophgo BM1684X/BM1688☆253Updated this week
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆84Updated this week
- stable diffusion using mnn☆67Updated 2 years ago
- llm deploy project based onnx.☆46Updated last year
- ☆1,072Updated last month
- Run Large Language Models on RK3588 with GPU-acceleration☆117Updated 2 years ago
- The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.)…☆839Updated this week
- A Toolkit to Help Optimize Onnx Model☆236Updated last week
- Superresolution running on Rockchip NPU (RK3588, etc..)☆19Updated last year
- ncnn android paddle ocr v5☆122Updated last month
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆108Updated this week
- Explore LLM model deployment based on AXera's AI chips☆123Updated this week
- Port of Facebook's LLaMA model in C/C++☆64Updated 6 months ago
- Port of Facebook's LLaMA model in C/C++☆103Updated last week
- Large Language Model Onnx Inference Framework☆36Updated 2 weeks ago
- Inference RWKV with multiple supported backends.☆66Updated this week
- top-like script for rockhip NPUs on linux☆60Updated last week
- Streaming TTS based on Piper with optional RK3588 NPU support☆112Updated 6 months ago
- PyTorch Neural Network eXchange☆642Updated this week
- ncnn android yolov8 realtime detection, segmentation, pose estimation, classification and obb☆144Updated last month
- ☆166Updated last week
- ☆41Updated 7 months ago