jeffzhou2000 / ggml-hexagonLinks
the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml-org/llama.cpp/pull/12326. not maintained since Jul 15 2025
☆31Updated 2 months ago
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below
Sorting:
- LLM inference in C/C++☆45Updated last week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆83Updated last week
- llm deploy project based onnx.☆44Updated 11 months ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆188Updated 2 years ago
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆73Updated last week
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆32Updated last year
- Run generative AI models in sophgo BM1684X/BM1688☆248Updated last week
- 使用 CUDA C++ 实现的 llama 模型推理框架☆62Updated 11 months ago
- Sophgo AI chips driver and runtime library.☆24Updated last week
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆86Updated this week
- Large Language Model Onnx Inference Framework☆36Updated 8 months ago
- ☆32Updated last year
- A converter for llama2.c legacy models to ncnn models.☆81Updated last year
- stable diffusion using mnn☆67Updated 2 years ago
- ☆38Updated 6 months ago
- llm-export can export llm model to onnx.☆313Updated last month
- ggml学习笔记,ggml是一个机器学习的推理框架☆18Updated last year
- ☆124Updated last year
- ☆33Updated 8 months ago
- Header-only safetensors loader and saver in C++☆67Updated 4 months ago
- FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.☆89Updated last week
- Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"☆55Updated 8 months ago
- llama 2 Inference☆41Updated last year
- TensorRT encapsulation, learn, rewrite, practice.☆29Updated 2 years ago
- A bunch of coding tutorials for my Youtube videos on Neural Network Quantization.☆22Updated last year
- ☆166Updated last week
- ☆10Updated last year
- ☆37Updated 11 months ago
- ☆150Updated 8 months ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆75Updated last year