jeffzhou2000 / ggml-hexagonLinks
the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml-org/llama.cpp/pull/12326. not maintained since Jul 15 2025
☆29Updated last month
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below
Sorting:
- LLM inference in C/C++☆44Updated this week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆79Updated last week
- llm deploy project based onnx.☆43Updated 10 months ago
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆64Updated this week
- ☆38Updated 4 months ago
- stable diffusion using mnn☆66Updated last year
- EasyNN是一个面向教学而开发的神经网络推理框架,旨在让大家0基础也能自主完成推理框架编写!☆32Updated last year
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆188Updated 2 years ago
- Run generative AI models in sophgo BM1684X/BM1688☆236Updated this week
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆69Updated last week
- ☆125Updated last year
- ggml学习笔记,ggml是一个机器学习的推理框架☆18Updated last year
- ☆32Updated 11 months ago
- Large Language Model Onnx Inference Framework☆36Updated 7 months ago
- TensorRT encapsulation, learn, rewrite, practice.☆28Updated 2 years ago
- llama 2 Inference☆41Updated last year
- A converter for llama2.c legacy models to ncnn models.☆81Updated last year
- llm-export can export llm model to onnx.☆304Updated 7 months ago
- Sophgo AI chips driver and runtime library.☆22Updated 2 weeks ago
- 使用 CUDA C++ 实现的 llama 模型推理框架☆60Updated 9 months ago
- Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"☆53Updated 7 months ago
- ☆21Updated 4 years ago
- A bunch of coding tutorials for my Youtube videos on Neural Network Quantization.☆19Updated last year
- FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.☆74Updated this week
- VeriSilicon Tensor Interface Module☆237Updated 7 months ago
- 使用 cutlass 实现 flash-attention 精简版,具有教学意义☆46Updated last year
- ☆12Updated 5 months ago
- ☆254Updated last year
- 机器学习编译 陈天奇☆41Updated 2 years ago
- ☆10Updated last year