Alternatives and similar repositories for llama-cpp-qnn-builder

Users that are interested in llama-cpp-qnn-builder are comparing it to the libraries listed below

• chraac / llama.cpp
  LLM inference in C/C++
  ☆48Updated this week
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆89Updated 3 weeks ago
• jeffzhou2000 / ggml-hexagon
  the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…
  ☆35Updated 5 months ago
• XiaoMi / StableDiffusionOnDevice
  本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。
  ☆229Updated last year
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆98Updated this week
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆210Updated last week
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆88Updated last year
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆337Updated 2 months ago
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆67Updated 2 years ago
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆257Updated this week
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆71Updated this week
• quic / ai-hub-apps
  The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…
  ☆350Updated last week
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆48Updated last year
• airockchip / rknn-llm
  ☆1,135Updated last month
• c0zaut / ez-er-rkllm-toolkit
  Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU
  ☆37Updated last year
• EdVince / diffusers-ncnn
  ☆84Updated 2 years ago
• HimariO / llama.cpp.qwen2.5vl
  Port of Facebook's LLaMA model in C/C++
  ☆65Updated 8 months ago
• marty1885 / rknn-superresolution
  Superresolution running on Rockchip NPU (RK3588, etc..)
  ☆19Updated last year
• tc-mb / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆105Updated last month
• lrw04 / llama2.c-to-ncnn
  A converter for llama2.c legacy models to ncnn models.
  ☆79Updated 2 years ago
• pnnx / pnnx
  PyTorch Neural Network eXchange
  ☆658Updated 2 weeks ago
• nihui / ncnn-android-ppocrv5
  ncnn android paddle ocr v5
  ☆131Updated 2 months ago
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated last month
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆162Updated 2 months ago
• NotPunchnox / rkllama
  Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…
  ☆364Updated last week
• ramonbroox / rknputop
  top-like script for rockhip NPUs on linux
  ☆63Updated last month
• gesanqiu / Chinese_MobileBert_on_SNPE
  Run Chinese MobileBert model on SNPE.
  ☆15Updated 2 years ago
• marty1885 / llama.cpp
  My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend
  ☆112Updated last month
• futz12 / ncnn_llm
  A repo for llm on ncnn
  ☆120Updated last week
• marty1885 / paroli
  Streaming TTS based on Piper with optional RK3588 NPU support
  ☆114Updated 8 months ago