the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml-org/llama.cpp/pull/12326. not maintained since Jul 15 2025
☆39Jul 14, 2025Updated 9 months ago
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Apr 10, 2026Updated last week
- LLM inference in C/C++☆50Apr 8, 2026Updated last week
- Repository to learn Hexagon DSP and HVX Programming☆26Aug 23, 2019Updated 6 years ago
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆188Jun 12, 2025Updated 10 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆91Feb 14, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- QT based multi-platform Nordic Nrf51822 device firmware OTA updater.☆15Feb 7, 2021Updated 5 years ago
- ☆10Jul 18, 2024Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- ☆11Feb 5, 2026Updated 2 months ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- 瑞芯微芯片的rknn推理框架部署(yolo模型)☆14Jul 17, 2025Updated 9 months ago
- The operating system project created by @MouriNaruto for achieving the dream.☆10Updated this week
- ☆13Oct 17, 2024Updated last year
- ☆27Jun 30, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Sophgo AI chips driver and runtime library.☆24Updated this week
- ☆33Jul 23, 2024Updated last year
- A one-page-only CGraph-API-liked DAG project.☆26Feb 11, 2025Updated last year
- ☆20Dec 29, 2023Updated 2 years ago
- Cortex-M3 development tree☆15Jan 4, 2015Updated 11 years ago
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 2 years ago
- Python utility to convert PyTorch model weights from '.bin' to '.safetensors' format.☆18Sep 19, 2025Updated 7 months ago
- Fast Multimodal LLM on Mobile Devices☆1,470Apr 12, 2026Updated last week
- 官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。☆16Sep 25, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型 ，包括其配套的模型运行框架。☆237Mar 29, 2024Updated 2 years ago
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆22Nov 6, 2023Updated 2 years ago
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆47Feb 13, 2025Updated last year
- Sample benchmark demonstrating the VK_NV_cooperative_vector extension☆14Dec 22, 2025Updated 3 months ago
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆21Jan 5, 2026Updated 3 months ago
- Qualcomm Hexagon NN Offload Framework☆45Nov 5, 2020Updated 5 years ago
- Inference RWKV with multiple supported backends.☆86Updated this week
- SNN implementation of the Fourier transform in neuromorphic hardware☆10Mar 7, 2022Updated 4 years ago
- Example of SenseCraft Model Assistant Model deployment related to ESP32☆33Apr 9, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An Example Plugin for MelonLoader☆11Dec 8, 2024Updated last year
- Safer rust wrapper over mnn☆20Mar 5, 2026Updated last month
- ☆34Sep 8, 2024Updated last year
- The offcial implementation of the Moment Neural Network (MNN)☆12Apr 3, 2026Updated 2 weeks ago
- ☆41Mar 25, 2026Updated 3 weeks ago
- Mainline Linux tree for various devices, sometimes only for fun :)☆17Feb 8, 2026Updated 2 months ago
- Port of Funasr's Paraformer model in C/C++☆42Jun 19, 2024Updated last year