the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml-org/llama.cpp/pull/12326. not maintained since Jul 15 2025
☆42Jul 14, 2025Updated 10 months ago
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆27Updated this week
- LLM inference in C/C++☆52Updated this week
- Repository to learn Hexagon DSP and HVX Programming☆27Aug 23, 2019Updated 6 years ago
- a website for accessing many models through api（deepseek、Qwen、Hunyuan etc.）☆16Jul 12, 2025Updated 10 months ago
- 给llvm17.0.6添加一个新后端Cpu0☆12Apr 22, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆192Jun 12, 2025Updated 11 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆91Updated this week
- ☆10Jul 18, 2024Updated last year
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- FastRPC is Qualcomm's userspace library that facilitates efficient remote procedure calls between the CPU and DSP for high-performance co…☆94May 20, 2026Updated last week
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- LLM inference in C/C++☆31Jan 27, 2026Updated 4 months ago
- The operating system project created by @MouriNaruto for achieving the dream.☆10May 11, 2026Updated 2 weeks ago
- ☆13Oct 17, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆28Jun 30, 2025Updated 10 months ago
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆120May 15, 2026Updated 2 weeks ago
- Sophgo AI chips driver and runtime library.☆24May 19, 2026Updated last week
- A one-page-only CGraph-API-liked DAG project.☆27Feb 11, 2025Updated last year
- ☆11Sep 4, 2025Updated 8 months ago
- Cortex-M3 development tree☆15Jan 4, 2015Updated 11 years ago
- WinForm & WPF Controls to View/Capture from a webcam using AForge.NET☆15Jun 15, 2020Updated 5 years ago
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 2 years ago
- Python utility to convert PyTorch model weights from '.bin' to '.safetensors' format.☆18Sep 19, 2025Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。☆16Sep 25, 2023Updated 2 years ago
- Fast Multimodal LLM on Mobile Devices☆1,515Apr 30, 2026Updated 3 weeks ago
- Bjontegaard metric calculation. Include BD-PSNR and BD-rate☆14Sep 4, 2024Updated last year
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆22Nov 6, 2023Updated 2 years ago
- Converting Chinese sentences into pinyin sequences, implemented in C++, very fast and easy to deploy.☆21Jan 5, 2026Updated 4 months ago
- Qualcomm Hexagon NN Offload Framework☆45Nov 5, 2020Updated 5 years ago
- An Example Plugin for MelonLoader☆11Dec 8, 2024Updated last year
- Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton☆50May 12, 2026Updated 2 weeks ago
- Inference RWKV with multiple supported backends.☆92Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A modular framework for building massively parallel agentic systems☆32Sep 8, 2025Updated 8 months ago
- Example of SenseCraft Model Assistant Model deployment related to ESP32☆33Apr 9, 2025Updated last year
- ☆34Sep 8, 2024Updated last year
- ☆46May 20, 2026Updated last week
- Port of Funasr's Paraformer model in C/C++☆43Jun 19, 2024Updated last year
- yolov8 旋转目标检测部署，瑞芯微RKNN芯片部署、地平线Horizon芯片部署、TensorRT部署☆28Jun 4, 2024Updated last year
- Development containers for triton and triton-cpu☆28May 10, 2026Updated 2 weeks ago