the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml-org/llama.cpp/pull/12326. not maintained since Jul 15 2025
☆41Jul 14, 2025Updated 9 months ago
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆23May 2, 2026Updated last week
- LLM inference in C/C++☆51May 2, 2026Updated last week
- Repository to learn Hexagon DSP and HVX Programming☆26Aug 23, 2019Updated 6 years ago
- a website for accessing many models through api（deepseek、Qwen、Hunyuan etc.）☆16Jul 12, 2025Updated 9 months ago
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆192Jun 12, 2025Updated 10 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆91Updated this week
- QT based multi-platform Nordic Nrf51822 device firmware OTA updater.☆15Feb 7, 2021Updated 5 years ago
- ☆10Jul 18, 2024Updated last year
- ☆11Feb 5, 2026Updated 3 months ago
- 一个基于Rhealstone基准程序方法的实时系统性能测试框架☆22Jan 17, 2024Updated 2 years ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- 瑞芯微芯片的rknn推理框架部署(yolo模型)☆14Jul 17, 2025Updated 9 months ago
- LLM inference in C/C++☆30Jan 27, 2026Updated 3 months ago
- ☆13Oct 17, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆28Jun 30, 2025Updated 10 months ago
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆119Apr 30, 2026Updated last week
- Sophgo AI chips driver and runtime library.☆24Apr 20, 2026Updated 2 weeks ago
- ☆33Jul 23, 2024Updated last year
- A one-page-only CGraph-API-liked DAG project.☆26Feb 11, 2025Updated last year
- ☆20Dec 29, 2023Updated 2 years ago
- ☆11Sep 4, 2025Updated 8 months ago
- Cortex-M3 development tree☆15Jan 4, 2015Updated 11 years ago
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Fast Multimodal LLM on Mobile Devices☆1,497Apr 30, 2026Updated last week
- Bjontegaard metric calculation. Include BD-PSNR and BD-rate☆13Sep 4, 2024Updated last year
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆239Mar 29, 2024Updated 2 years ago
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆48Feb 13, 2025Updated last year
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆22Nov 6, 2023Updated 2 years ago
- Sample benchmark demonstrating the VK_NV_cooperative_vector extension☆15Dec 22, 2025Updated 4 months ago
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆21Jan 5, 2026Updated 4 months ago
- Qualcomm Hexagon NN Offload Framework☆45Nov 5, 2020Updated 5 years ago
- An Example Plugin for MelonLoader☆11Dec 8, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Example of SenseCraft Model Assistant Model deployment related to ESP32☆33Apr 9, 2025Updated last year
- ☆34Sep 8, 2024Updated last year
- ☆45Apr 27, 2026Updated last week
- Port of Funasr's Paraformer model in C/C++☆43Jun 19, 2024Updated last year
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆28Jun 4, 2024Updated last year
- mnn tts demo.☆19May 7, 2025Updated last year
- my fork of libxml2☆11May 11, 2011Updated 14 years ago