the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml-org/llama.cpp/pull/12326. not maintained since Jul 15 2025
☆38Jul 14, 2025Updated 8 months ago
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Feb 7, 2026Updated last month
- LLM inference in C/C++☆48Mar 22, 2026Updated last week
- Repository to learn Hexagon DSP and HVX Programming☆26Aug 23, 2019Updated 6 years ago
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆187Jun 12, 2025Updated 9 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆91Feb 14, 2026Updated last month
- NordVPN Threat Protection Pro™ • AdTake your cybersecurity to the next level. Block phishing, malware, trackers, and ads. Lightweight app that works with all browsers.
- ☆10Jul 18, 2024Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- FastRPC is Qualcomm's userspace library that facilitates efficient remote procedure calls between the CPU and DSP for high-performance co…☆82Mar 13, 2026Updated 2 weeks ago
- ☆11Feb 5, 2026Updated last month
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- 瑞芯微芯片的rknn推理框架部署(yolo模型)☆14Jul 17, 2025Updated 8 months ago
- The operating system project created by @MouriNaruto for achieving the dream.☆10Mar 16, 2026Updated last week
- ☆13Oct 17, 2024Updated last year
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆118Mar 17, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Sophgo AI chips driver and runtime library.☆24Updated this week
- ☆28Jun 30, 2025Updated 9 months ago
- ☆33Jul 23, 2024Updated last year
- A one-page-only CGraph-API-liked DAG project.☆26Feb 11, 2025Updated last year
- ☆20Dec 29, 2023Updated 2 years ago
- ☆11Sep 4, 2025Updated 6 months ago
- WinForm & WPF Controls to View/Capture from a webcam using AForge.NET☆15Jun 15, 2020Updated 5 years ago
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 2 years ago
- Fast Multimodal LLM on Mobile Devices☆1,449Updated this week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Python utility to convert PyTorch model weights from '.bin' to '.safetensors' format.☆18Sep 19, 2025Updated 6 months ago
- 官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。☆16Sep 25, 2023Updated 2 years ago
- Bjontegaard metric calculation. Include BD-PSNR and BD-rate☆13Sep 4, 2024Updated last year
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆235Mar 29, 2024Updated 2 years ago
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆22Nov 6, 2023Updated 2 years ago
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆46Feb 13, 2025Updated last year
- ☆26Mar 18, 2026Updated last week
- Qualcomm Hexagon NN Offload Framework☆45Nov 5, 2020Updated 5 years ago
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆21Jan 5, 2026Updated 2 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Inference RWKV with multiple supported backends.☆82Mar 11, 2026Updated 2 weeks ago
- Example of SenseCraft Model Assistant Model deployment related to ESP32☆32Apr 9, 2025Updated 11 months ago
- An Example Plugin for MelonLoader☆11Dec 8, 2024Updated last year
- [ArXiv 2025] A curated list of papers on on-device large language models, focusing on model compression and system optimization technique…☆30Jan 27, 2026Updated 2 months ago
- Safer rust wrapper over mnn☆20Mar 5, 2026Updated 3 weeks ago
- A modular framework for building massively parallel agentic systems☆31Sep 8, 2025Updated 6 months ago
- ☆34Sep 8, 2024Updated last year