the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, history of ggml-hexagon: https://github.com/zhouwg/ggml-hexagon/discussions/18.
☆50Aug 9, 2026Updated this week
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆29Aug 3, 2026Updated last week
- Self-implemented NN operators for Qualcomm's Hexagon NPU☆77Sep 30, 2025Updated 10 months ago
- LLM inference in C/C++☆53Aug 3, 2026Updated last week
- ☆93Dec 16, 2025Updated 7 months ago
- High-speed and easy-use LLM serving framework for local deployment☆164Aug 7, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Repository to learn Hexagon DSP and HVX Programming☆28Aug 23, 2019Updated 6 years ago
- some hexagon intrinsic examples based on Qualcomm Hexagon☆17Mar 7, 2025Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆95Jul 27, 2026Updated 2 weeks ago
- QT based multi-platform Nordic Nrf51822 device firmware OTA updater.☆15Feb 7, 2021Updated 5 years ago
- ☆10Jul 18, 2024Updated 2 years ago
- Hexagon-MLIR is a compiler toolchain for compiling and executing AI kernels and models on Qualcomm Hexagon Neural Processing Units (NPUs)…☆185Jul 2, 2026Updated last month
- Fast Multimodal LLM on Mobile Devices☆1,584Updated this week
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆247Mar 29, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆194Updated this week
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆444Updated this week
- ☆11Feb 5, 2026Updated 6 months ago
- a ai infra framework for edge device base on nndeploy☆18Nov 27, 2025Updated 8 months ago
- ☆181Jun 21, 2026Updated last month
- 瑞芯微芯片的rknn推理框架部署(yolo模型)☆15Jul 17, 2025Updated last year
- LLM inference in C/C++☆33Jan 27, 2026Updated 6 months ago
- ☆16Apr 13, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- hexagon tutorial☆58Mar 29, 2026Updated 4 months ago
- A lightweight, single-header C++11 Jinja2 template engine for LLM chat templates.☆20Mar 4, 2026Updated 5 months ago
- Android native mediacodec decode/encode demo☆14Dec 16, 2021Updated 4 years ago
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆121Jul 29, 2026Updated last week
- ☆29Jun 30, 2025Updated last year
- Sophgo AI chips driver and runtime library.☆27Jul 27, 2026Updated 2 weeks ago
- ☆22Nov 6, 2025Updated 9 months ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆196Aug 17, 2023Updated 2 years ago
- ☆34Jul 23, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A one-page-only CGraph-API-liked DAG project.☆28Feb 11, 2025Updated last year
- Port of Funasr's Paraformer model in C/C++☆42Jun 19, 2024Updated 2 years ago
- ☆43Mar 29, 2025Updated last year
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 3 years ago
- Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agents☆32Dec 6, 2024Updated last year
- ☆11Sep 4, 2025Updated 11 months ago
- WinForm & WPF Controls to View/Capture from a webcam using AForge.NET☆16Jun 15, 2020Updated 6 years ago