Alternatives and similar repositories for llama.cpp-npu

Users that are interested in llama.cpp-npu are comparing it to the libraries listed below

• haozixu / htp-ops-lib
  Self-implemented NN operators for Qualcomm's Hexagon NPU
  ☆37Updated 3 months ago
• xxxxyu / FlexNN
  Flexible DNN inference under changing memory budgets
  ☆58Updated 11 months ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆90Updated last month
• gesanqiu / Chinese_MobileBert_on_SNPE
  Run Chinese MobileBert model on SNPE.
  ☆15Updated 2 years ago
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆52Updated last year
• MegEngine / mperf
  mperf是一个面向移动/嵌入式平台的算子性能调优工具箱
  ☆192Updated 2 years ago
• carlushuang / cpu_gemm_opt
  how to design cpu gemm on x86 with avx256, that can beat openblas.
  ☆73Updated 6 years ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆111Updated 3 weeks ago
• jeffzhou2000 / ggml-hexagon
  the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…
  ☆35Updated 6 months ago
• xiaoyi018 / simple_gemm
  ☆22Updated 4 years ago
• tpoisonooo / chgemm
  symmetric int8 gemm
  ☆67Updated 5 years ago
• daquexian / faster-rwkv
  ☆125Updated 2 years ago
• mlc-ai / relax
  ☆171Updated 2 weeks ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆57Updated 3 years ago
• mit-han-lab / parallel-computing-tutorial
  ☆176Updated 2 years ago
• OpenPPL / ppl.pmx
  ☆60Updated last year
• ByteDance-Seed / decoupleQ
  A quantization algorithm for LLM
  ☆147Updated last year
• EdVince / llm-cpp
  ☆33Updated last year
• BBuf / how-to-optimize-gemm
  ☆98Updated 4 years ago
• xinetzone / tvm-book
  ☆18Updated last month
• Qualcomm-AI-research / FP8-quantization
  ☆169Updated 2 years ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆104Updated 7 years ago
• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆50Updated 2 years ago
• StudyingLover / ggml-tutorial
  ☆34Updated last year
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆123Updated last year
• ByteDance-Seed / cudaLLM
  ☆126Updated 4 months ago
• flagos-ai / FlagTree
  FlagTree is a unified compiler supporting multiple AI chip backends for custom Deep Learning operations, which is forked from triton-lang…
  ☆155Updated last week
• Qualcomm-AI-research / transformer-quantization
  ☆208Updated 4 years ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆85Updated 11 months ago
• jeho-lee / Awesome-On-Device-AI-Systems
  ☆107Updated 2 weeks ago