Alternatives and similar repositories for llama-cpp-qnn-builder

Users that are interested in llama-cpp-qnn-builder are comparing it to the libraries listed below

• chraac / llama.cpp
  LLM inference in C/C++
  ☆48Updated this week
• jeffzhou2000 / ggml-hexagon
  the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…
  ☆35Updated 6 months ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆90Updated last month
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆340Updated 2 months ago
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆89Updated last year
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆260Updated last week
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆217Updated this week
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆67Updated 2 years ago
• XiaoMi / StableDiffusionOnDevice
  本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。
  ☆231Updated last year
• quic / ai-hub-apps
  The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…
  ☆355Updated last month
• tc-mb / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆105Updated last month
• nihui / ncnn-android-ppocrv5
  ncnn android paddle ocr v5
  ☆137Updated this week
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆49Updated last year
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated last month
• wkt / YoloMobile
  A Android Library for YOLOv5/YOLOv7/YOLOv8 Detection and Pose Inference Based on NCNN
  ☆58Updated last year
• futz12 / ncnn_llm
  A repo for llm on ncnn
  ☆178Updated 2 weeks ago
• nihui / ncnn-android-yolov8
  ncnn android yolov8 realtime detection, segmentation, pose estimation, classification and obb
  ☆162Updated 3 months ago
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated last year
• pnnx / pnnx
  PyTorch Neural Network eXchange
  ☆665Updated this week
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆102Updated this week
• DakeQQ / YOLO-Depth-Estimation-for-Android
  Demonstration of combine YOLO and depth estimation on Android device.
  ☆66Updated 2 months ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆308Updated this week
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆136Updated this week
• mpj1234 / ncnn-yolov12-android
  Yolov12 model supports android deployment.
  ☆132Updated 7 months ago
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆74Updated this week
• ramonbroox / rknputop
  top-like script for rockhip NPUs on linux
  ☆63Updated 2 months ago
• Chrisz236 / llm-rk3588
  Run Large Language Models on RK3588 with GPU-acceleration
  ☆121Updated 2 years ago
• DefTruth / lite.ai.toolkit
  🛠 A lite C++ toolkit: contains 100+ Awesome AI models, support MNN, NCNN, TNN, ONNXRuntime and TensorRT. 🎉🎉
  ☆27Updated 9 months ago
• quic / qidk
  ☆177Updated 3 weeks ago