Alternatives and similar repositories for ggml-hexagon:

Users that are interested in ggml-hexagon are comparing it to the libraries listed below

• chraac / llama.cpp
  LLM inference in C/C++
  ☆34Updated last week
• quic / ai-engine-direct-helper
  ☆32Updated 3 weeks ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆60Updated this week
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆32Updated 2 months ago
• daquexian / faster-rwkv
  ☆124Updated last year
• tanjatang / snpe_resnet
  snpe tutorial
  ☆10Updated last year
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆35Updated 5 months ago
• OpenPPL / ppl.kernel.cuda
  ☆36Updated 5 months ago
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆179Updated last year
• ozanarmagan / clip_tokenizer_cpp
  ☆10Updated 8 months ago
• EdVince / llm-cpp
  ☆32Updated 8 months ago
• gesanqiu / Chinese_MobileBert_on_SNPE
  Run Chinese MobileBert model on SNPE.
  ☆14Updated last year
• zeroine / cutlass-cute-sample
  ☆29Updated 11 months ago
• airockchip / rknpu_ddk
  DDK for Rockchip NPU
  ☆61Updated 4 years ago
• kilianhae / FlashAttention.C
  Flash Attention in raw Cuda C beating PyTorch
  ☆20Updated 10 months ago
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆87Updated 2 weeks ago
• lovemefan / ggml-learning-notes
  ggml学习笔记，ggml是一个机器学习的推理框架
  ☆14Updated last year
• mlc-ai / relax
  ☆157Updated this week
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆87Updated last year
• zpethan / master-cudnn
  解读cudnn文档，掌握其用法
  ☆16Updated 11 months ago
• OpenPPL / ppl.common
  Common libraries for PPL projects
  ☆29Updated 3 weeks ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆108Updated 6 months ago
• StudyingLover / ggml-tutorial
  ☆30Updated 6 months ago
• AXERA-TECH / SAM-ONNX-AX650-CPP
  ☆16Updated last year
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆26Updated 7 months ago
• sipeed / axpi_bsp_sdk
  linux bsp app & sample for axpi (ax620a)
  ☆34Updated last year
• syoyo / safetensors-cpp
  Header-only safetensors loader and saver in C++
  ☆56Updated 3 weeks ago
• caijixueIT / CUDA_Learning_for_Freshman
  ☆10Updated 3 weeks ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆90Updated last month
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆48Updated 4 months ago