Alternatives and similar repositories for ggml-hexagon

Users that are interested in ggml-hexagon are comparing it to the libraries listed below

• chraac / llama.cpp
  LLM inference in C/C++
  ☆44Updated 2 weeks ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆77Updated 3 weeks ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆42Updated 9 months ago
• sophgo / libsophon
  Sophgo AI chips driver and runtime library.
  ☆22Updated 2 weeks ago
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆188Updated last year
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆59Updated this week
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆17Updated last year
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆66Updated last year
• xxxxyu / FlexNN
  Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"
  ☆54Updated 6 months ago
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆81Updated last year
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated 6 months ago
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆58Updated 8 months ago
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆31Updated 11 months ago
• daquexian / faster-rwkv
  ☆124Updated last year
• sunkx109 / llama.cpp
  llama 2 Inference
  ☆41Updated last year
• lx200916 / ChatBotApp
  ☆36Updated 4 months ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆62Updated 2 weeks ago
• StudyingLover / ggml-tutorial
  ☆32Updated 10 months ago
• sipeed / axpi_bsp_sdk
  linux bsp app & sample for axpi (ax620a)
  ☆35Updated 2 years ago
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆231Updated last week
• ozanarmagan / clip_tokenizer_cpp
  ☆10Updated last year
• JieRen98 / SGEMM-SASS-Annotation
  ☆21Updated 4 years ago
• FlagTree / flagtree
  FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.
  ☆67Updated this week
• wangzyon / trt_learn
  TensorRT encapsulation, learn, rewrite, practice.
  ☆28Updated 2 years ago
• VeriSilicon / TIM-VX
  VeriSilicon Tensor Interface Module
  ☆236Updated 6 months ago
• EdVince / llm-cpp
  ☆32Updated last year
• OpenPPL / ppl.kernel.cuda
  ☆37Updated 9 months ago
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆109Updated 3 weeks ago
• airockchip / rknpu_ddk
  DDK for Rockchip NPU
  ☆65Updated 4 years ago
• Tencent / BlazerML-tvm
  Tencent Distribution of TVM
  ☆15Updated 2 years ago