Alternatives and similar repositories for QNN-Android-Server

Users that are interested in QNN-Android-Server are comparing it to the libraries listed below

• gesanqiu / Chinese_MobileBert_on_SNPE
  Run Chinese MobileBert model on SNPE.
  ☆15Updated 2 years ago
• jnulzl / PyTorch-QAT
  PyTorch Quantization Aware Training(QAT,量化感知训练)
  ☆42Updated 2 years ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆90Updated 2 weeks ago
• DakeQQ / YOLO-Depth-Estimation-for-Android
  Demonstration of combine YOLO and depth estimation on Android device.
  ☆66Updated 2 months ago
• ppogg / Deepstream-Box
  deepstream + cuda，yolo26，yolo-master，yolo11，yolov8，sam，transformer, etc.
  ☆35Updated last week
• quic / qidk
  ☆179Updated 2 weeks ago
• AXERA-TECH / yolov5-qat
  Try to export the ONNX QDQ model that conforms to the AXERA NPU quantization specification. Currently, only w8a8 is supported.
  ☆11Updated last year
• Ranking666 / Base-quantization
  base quantization methods including: QAT, PTQ, per_channel, per_tensor, dorefa, lsq, adaround, omse, Histogram, bias_correction.etc
  ☆51Updated 3 years ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆163Updated 3 months ago
• KoKoLates / snpe-yolov7-inference
  A yolov7-tiny model inference applied on qualcomm snpe for pedestrian detection with embedded system.
  ☆13Updated last year
• gesanqiu / SNPE_Tutorial
  A simple tutorial of SNPE.
  ☆183Updated 2 years ago
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆111Updated this week
• leimao / TensorRT-Custom-Plugin-Example
  Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration
  ☆78Updated 8 months ago
• NVIDIA / TensorRT-Edge-LLM
  High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI
  ☆227Updated 3 weeks ago
• MegEngine / examples
  A set of examples around MegEngine
  ☆31Updated 2 years ago
• kalfazed / multi-thread-programming
  This is a repository to practice multi-thread programming in C++
  ☆27Updated last year
• hopef / llama3_chat
  Llama3 Streaming Chat Sample
  ☆22Updated last year
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆49Updated last year
• sesmfs / onnx_quant_tool
  An onnx-based quantitation tool.
  ☆71Updated 2 years ago
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆37Updated last year
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆70Updated last year
• Tlntin / trt2023
  ☆26Updated 2 years ago
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆67Updated 2 years ago
• ModelTC / Dipoorlet
  Offline Quantization Tools for Deploy.
  ☆142Updated 2 years ago
• wangzhaode / tokenizer.cpp
  A lightweight, production-ready C++ library for LLM tokenization, fully compatible with HuggingFace tokenizer.json.
  ☆21Updated last month
• YukSing12 / anchordetr_tensorrt
  trt-hackathon-2022 三等奖方案
  ☆10Updated 2 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Updated 2 years ago
• tanjatang / snpe_resnet
  snpe tutorial
  ☆10Updated 2 years ago
• lix19937 / tensorrt-insight
  Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda
  ☆23Updated 3 weeks ago
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated 2 months ago