Alternative llama.cpp backend for Qualcomm Hexagon NPU (Android / WoS(Windows on Snapdragon) / Linux), https://github.com/kan-linux/ggml-hexagon/discussions/84
☆57Sep 20, 2026Updated this week
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Aug 3, 2026Updated last month
- Self-implemented NN operators for Qualcomm's Hexagon NPU☆77Sep 30, 2025Updated 11 months ago
- LLM inference in C/C++☆54Sep 3, 2026Updated 2 weeks ago
- ☆95Dec 16, 2025Updated 9 months ago
- workbench for learning and practicing on-device AI technologies under real-world scenarios on Android smartphones with online TV. powered…☆200Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- a website for accessing many models through api（deepseek、Qwen、Hunyuan etc.）☆16Jul 12, 2025Updated last year
- High-speed and easy-use LLM serving framework for local deployment☆166Aug 7, 2025Updated last year
- 给llvm17.0.6添加一个新后端Cpu0☆12Apr 22, 2024Updated 2 years ago
- some hexagon intrinsic examples based on Qualcomm Hexagon☆18Mar 7, 2025Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆99Jul 27, 2026Updated last month
- QT based multi-platform Nordic Nrf51822 device firmware OTA updater.☆15Feb 7, 2021Updated 5 years ago
- 一个基于Rhealstone基准程序方法的实时系统性能测试框架☆23Jan 17, 2024Updated 2 years ago
- Hexagon-MLIR is a compiler toolchain for compiling and executing AI kernels and models on Qualcomm Hexagon Neural Processing Units (NPUs)…☆231Updated this week
- Fast Multimodal LLM on Mobile Devices☆1,613Sep 8, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆248Mar 29, 2024Updated 2 years ago
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆240Updated this week
- ggml学习笔记，ggml是一个机器学习的推理框架☆18Mar 24, 2024Updated 2 years ago
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆460Updated this week
- a ai infra framework for edge device base on nndeploy☆18Nov 27, 2025Updated 9 months ago
- FastRPC is Qualcomm's userspace library that facilitates efficient remote procedure calls between the CPU and DSP for high-performance co…☆114Updated this week
- 瑞芯微芯片的rknn推理框架部署(yolo模型)☆15Jul 17, 2025Updated last year
- LLM inference in C/C++☆34Jan 27, 2026Updated 7 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- hexagon tutorial☆66Mar 29, 2026Updated 5 months ago
- A lightweight, single-header C++11 Jinja2 template engine for LLM chat templates.☆20Mar 4, 2026Updated 6 months ago
- Android native mediacodec decode/encode demo☆14Dec 16, 2021Updated 4 years ago
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆122Jul 29, 2026Updated last month
- ☆29Jun 30, 2025Updated last year
- Sophgo AI chips driver and runtime library.☆27Aug 10, 2026Updated last month
- ☆23Nov 6, 2025Updated 10 months ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆197Aug 17, 2023Updated 3 years ago
- ☆43Mar 29, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- RKNN模型推理部署模板☆24Aug 11, 2023Updated 3 years ago
- ☆11Sep 4, 2025Updated last year
- WinForm & WPF Controls to View/Capture from a webcam using AForge.NET☆16Jun 15, 2020Updated 6 years ago
- Python utility to convert PyTorch model weights from '.bin' to '.safetensors' format.☆18Sep 19, 2025Updated last year
- RKNN-YOLOV5-BatchInference-MultiThreadingYOLOV5多张图片多线程C++推理☆24Nov 6, 2023Updated 2 years ago
- To convert CosyVoice model to ONNX☆16Dec 22, 2025Updated 8 months ago
- Bjontegaard metric calculation. Include BD-PSNR and BD-rate☆14Sep 4, 2024Updated 2 years ago