zhouwg / ggml-hexagon
try to build a fully open-source ggml-hexagon backend for llama.cpp on Android phone equipped with Qualcomm's Hexagon NPU, details can be seen at https://github.com/zhouwg/ggml-hexagon/discussions/18
☆19Updated this week
Alternatives and similar repositories for ggml-hexagon
Users that are interested in ggml-hexagon are comparing it to the libraries listed below
Sorting:
- LLM inference in C/C++☆41Updated this week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆64Updated last week
- llm deploy project based onnx.☆36Updated 7 months ago
- ☆32Updated 9 months ago
- A converter for llama2.c legacy models to ncnn models.☆87Updated last year
- ☆124Updated last year
- Large Language Model Onnx Inference Framework☆33Updated 4 months ago
- ☆33Updated last month
- ☆36Updated this week
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆91Updated 3 weeks ago
- Header-only safetensors loader and saver in C++☆61Updated last week
- ☆156Updated last month
- ☆10Updated 9 months ago
- Detect CPU features with single-file☆391Updated this week
- ☆30Updated 8 months ago
- Run Large Language Models on RK3588 with GPU-acceleration☆102Updated last year
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆185Updated last year
- Run Chinese MobileBert model on SNPE.☆14Updated last year
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆47Updated last year
- Sophgo AI chips driver and runtime library.☆21Updated 2 weeks ago
- 🛠 A lite C++ toolkit: contains 100+ Awesome AI models, support MNN, NCNN, TNN, ONNXRuntime and TensorRT. 🎉🎉☆14Updated last month
- A Toolkit to Help Optimize Onnx Model☆145Updated this week
- Fork of https://source.codeaurora.org/quic/hexagon_nn/nnlib☆57Updated 2 years ago
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆30Updated 4 months ago
- ggml学习笔记,ggml是一个机器学习的推理框架☆15Updated last year
- DragGan in NCNN with c++☆50Updated last year
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆37Updated this week
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆18Updated 2 months ago
- DDK for Rockchip NPU☆61Updated 4 years ago
- Efficient inference of large language models.☆146Updated 5 months ago