Alternatives and similar repositories for ggml-hexagon

Users that are interested in ggml-hexagon are comparing it to the libraries listed below

• chraac / llama.cpp
  LLM inference in C/C++
  ☆46Updated this week
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆87Updated 3 weeks ago
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆84Updated this week
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆46Updated last year
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆191Updated 2 years ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆93Updated last week
• lx200916 / ChatBotApp
  ☆41Updated 7 months ago
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆33Updated last year
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆62Updated last year
• flagos-ai / flagtree
  FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.
  ☆131Updated this week
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆67Updated 2 years ago
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated 2 weeks ago
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆18Updated last year
• daquexian / faster-rwkv
  ☆124Updated last year
• StudyingLover / ggml-tutorial
  ☆34Updated last year
• weishengying / cute_gemm
  ☆20Updated last year
• mlc-ai / relax
  ☆168Updated this week
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆328Updated 3 weeks ago
• sunkx109 / llama.cpp
  llama 2 Inference
  ☆43Updated 2 years ago
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆253Updated this week
• caijixueIT / CUDA_Learning_for_Freshman
  ☆14Updated 2 weeks ago
• Ascend / triton-ascend
  Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend
  ☆82Updated this week
• futz12 / ncnn_llm
  A repo for llm on ncnn
  ☆33Updated last week
• Chrisz236 / llm-rk3588
  Run Large Language Models on RK3588 with GPU-acceleration
  ☆117Updated 2 years ago
• doongz / mlc-ai
  机器学习编译 陈天奇
  ☆49Updated 2 years ago
• wangzyon / trt_learn
  TensorRT encapsulation, learn, rewrite, practice.
  ☆29Updated 3 years ago
• chraac / llama-cpp-qnn-builder
  ☆10Updated last week
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆50Updated last year
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆132Updated 3 months ago
• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆50Updated 2 years ago