the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, history of ggml-hexagon: https://github.com/zhouwg/ggml-hexagon/discussions/18.
☆45Jun 26, 2026Updated this week
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆28May 23, 2026Updated last month
- LLM inference in C/C++☆53Jun 22, 2026Updated last week
- Repository to learn Hexagon DSP and HVX Programming☆28Aug 23, 2019Updated 6 years ago
- a website for accessing many models through api（deepseek、Qwen、Hunyuan etc.）☆16Jul 12, 2025Updated 11 months ago
- 给llvm17.0.6添加一个新后端Cpu0☆12Apr 22, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆194Jun 7, 2026Updated 3 weeks ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆94Jun 8, 2026Updated 3 weeks ago
- QT based multi-platform Nordic Nrf51822 device firmware OTA updater.☆15Feb 7, 2021Updated 5 years ago
- ☆10Jul 18, 2024Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- FastRPC is Qualcomm's userspace library that facilitates efficient remote procedure calls between the CPU and DSP for high-performance co…☆101Updated this week
- ☆11Feb 5, 2026Updated 4 months ago
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- 瑞芯微芯片的rknn推理框架部署(yolo模型)☆15Jul 17, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- LLM inference in C/C++☆32Jan 27, 2026Updated 5 months ago
- ☆28Jun 30, 2025Updated last year
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆120Updated this week
- This repo is DEPRECATED. Check our newer Android SDK☆10Apr 3, 2019Updated 7 years ago
- Sophgo AI chips driver and runtime library.☆24Jun 9, 2026Updated 3 weeks ago
- ☆33Jul 23, 2024Updated last year
- A one-page-only CGraph-API-liked DAG project.☆28Feb 11, 2025Updated last year
- ☆20Dec 29, 2023Updated 2 years ago
- Cortex-M3 development tree☆15Jan 4, 2015Updated 11 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 2 years ago
- Python utility to convert PyTorch model weights from '.bin' to '.safetensors' format.☆18Sep 19, 2025Updated 9 months ago
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Jan 12, 2025Updated last year
- 官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。☆16Sep 25, 2023Updated 2 years ago
- Fast Multimodal LLM on Mobile Devices☆1,552Jun 9, 2026Updated 3 weeks ago
- Bjontegaard metric calculation. Include BD-PSNR and BD-rate☆14Sep 4, 2024Updated last year
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆241Mar 29, 2024Updated 2 years ago
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆22Nov 6, 2023Updated 2 years ago
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆23Jan 5, 2026Updated 5 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Qualcomm Hexagon NN Offload Framework☆45Nov 5, 2020Updated 5 years ago
- An Example Plugin for MelonLoader☆11Dec 8, 2024Updated last year
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆50May 12, 2026Updated last month
- Safer rust wrapper over mnn☆23Mar 5, 2026Updated 3 months ago
- Inference RWKV with multiple supported backends.☆93Updated this week
- ☆34Sep 8, 2024Updated last year
- ☆46Jun 9, 2026Updated 3 weeks ago