jeffzhou2000 / ggml-hexagonLinks
the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml-org/llama.cpp/pull/12326. not maintained since Jul 15 2025
☆35Updated 3 months ago
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below
Sorting:
- LLM inference in C/C++☆46Updated last week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆85Updated this week
- llm deploy project based onnx.☆45Updated last year
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆91Updated this week
- ☆39Updated 7 months ago
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆79Updated last week
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆190Updated 2 years ago
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆33Updated last year
- Large Language Model Onnx Inference Framework☆36Updated 9 months ago
- ggml学习笔记,ggml是一个机器学习的推理框架☆18Updated last year
- High-speed and easy-use LLM serving framework for local deployment☆130Updated 2 months ago
- ☆124Updated last year
- Run generative AI models in sophgo BM1684X/BM1688☆251Updated this week
- 使用 CUDA C++ 实现的 llama 模型推理框架☆62Updated 11 months ago
- llm-export can export llm model to onnx.☆317Updated this week
- FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.☆93Updated this week
- ☆14Updated 7 months ago
- ☆18Updated last year
- A converter for llama2.c legacy models to ncnn models.☆80Updated last year
- ☆17Updated last year
- ☆33Updated last year
- stable diffusion using mnn☆67Updated 2 years ago
- ☆33Updated 8 months ago
- llama 2 Inference☆42Updated last year
- ☆37Updated last year
- 🎉My Collections of CUDA Kernels~☆11Updated last year
- Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"☆56Updated 9 months ago
- ☆56Updated 3 months ago
- 使用 cutlass 实现 flash-attention 精简版,具有教学意义☆50Updated last year
- ☆59Updated 11 months ago