Alternatives and similar repositories for ggml-hexagon

Users that are interested in ggml-hexagon are comparing it to the libraries listed below

• chraac / llama.cpp
  LLM inference in C/C++
  ☆41Updated last week
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆68Updated last week
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆37Updated 7 months ago
• sunkx109 / llama.cpp
  llama 2 Inference
  ☆41Updated last year
• daquexian / faster-rwkv
  ☆123Updated last year
• sophgo / libsophon
  Sophgo AI chips driver and runtime library.
  ☆21Updated last week
• ozanarmagan / clip_tokenizer_cpp
  ☆10Updated 10 months ago
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆187Updated last year
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆87Updated last year
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆35Updated 4 months ago
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆28Updated 9 months ago
• wangzyon / trt_learn
  TensorRT encapsulation, learn, rewrite, practice.
  ☆28Updated 2 years ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆43Updated this week
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆35Updated 3 years ago
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆68Updated last year
• EdVince / llm-cpp
  ☆32Updated 10 months ago
• lx200916 / ChatBotApp
  ☆34Updated 2 months ago
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed for developer to using Qualcomm® AI Runtime SDK to execute model on Windows on Snapdragon(WoS) and Linux platf…
  ☆41Updated this week
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆57Updated 6 months ago
• JieRen98 / SGEMM-SASS-Annotation
  ☆21Updated 4 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆109Updated 8 months ago
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆15Updated last year
• zeroine / cutlass-cute-sample
  ☆33Updated last year
• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆53Updated 4 months ago
• xlite-dev / ffpa-attn
  📚FFPA(Split-D): Extend FlashAttention with Split-D for large headdim, O(1) GPU SRAM complexity, 1.8x~3x↑🎉 faster than SDPA EA.
  ☆184Updated 3 weeks ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆148Updated 4 months ago
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated last year
• OpenPPL / ppl.kernel.cuda
  ☆36Updated 7 months ago
• syoyo / safetensors-cpp
  Header-only safetensors loader and saver in C++
  ☆62Updated 3 weeks ago
• zpye / SimpleInfer
  A simple neural network inference framework
  ☆25Updated last year