Alternatives and similar repositories for QNN-Android-Server

Users that are interested in QNN-Android-Server are comparing it to the libraries listed below

• jnulzl / PyTorch-QAT
  PyTorch Quantization Aware Training(QAT,量化感知训练)
  ☆42Updated 2 years ago
• gesanqiu / Chinese_MobileBert_on_SNPE
  Run Chinese MobileBert model on SNPE.
  ☆15Updated 2 years ago
• DakeQQ / YOLO-Depth-Estimation-for-Android
  Demonstration of combine YOLO and depth estimation on Android device.
  ☆62Updated last month
• AXERA-TECH / yolov5-qat
  Try to export the ONNX QDQ model that conforms to the AXERA NPU quantization specification. Currently, only w8a8 is supported.
  ☆11Updated last year
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆89Updated 3 weeks ago
• KoKoLates / snpe-yolov7-inference
  A yolov7-tiny model inference applied on qualcomm snpe for pedestrian detection with embedded system.
  ☆13Updated last year
• leimao / TensorRT-Custom-Plugin-Example
  Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration
  ☆74Updated 7 months ago
• gesanqiu / SNPE_Tutorial
  A simple tutorial of SNPE.
  ☆182Updated 2 years ago
• HuPengsheet / EasyNN
  EasyNN是一个面向教学而开发的神经网络推理框架，旨在让大家0基础也能自主完成推理框架编写！
  ☆34Updated last year
• quic / qidk
  ☆170Updated 2 weeks ago
• kalfazed / multi-thread-programming
  This is a repository to practice multi-thread programming in C++
  ☆26Updated last year
• quic / ai-engine-direct-helper
  QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …
  ☆98Updated this week
• hopef / llama3_chat
  Llama3 Streaming Chat Sample
  ☆22Updated last year
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆162Updated last month
• tanjatang / snpe_resnet
  snpe tutorial
  ☆10Updated 2 years ago
• emptysoal / cuda-image-preprocess
  Speed up image preprocess with cuda when handle image or tensorrt inference
  ☆80Updated last month
• sesmfs / onnx_quant_tool
  An onnx-based quantitation tool.
  ☆71Updated last year
• jeffzhou2000 / ggml-hexagon
  the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…
  ☆35Updated 5 months ago
• MegEngine / examples
  A set of examples around MegEngine
  ☆31Updated 2 years ago
• Ranking666 / Base-quantization
  base quantization methods including: QAT, PTQ, per_channel, per_tensor, dorefa, lsq, adaround, omse, Histogram, bias_correction.etc
  ☆51Updated 3 years ago
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆67Updated 2 years ago
• shouxieai / tensorRT_quantization
  该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。
  ☆71Updated 2 years ago
• l-sf / Nanodet_openvino_quant_deploy
  本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！
  ☆16Updated 2 years ago
• YukSing12 / anchordetr_tensorrt
  trt-hackathon-2022 三等奖方案
  ☆10Updated 2 years ago
• yhwang-hub / yolov5_QAT
  Quantize yolov5 using pytorch_quantization.🚀🚀🚀
  ☆14Updated 2 years ago
• raymond1123 / Flash-Attention
  ☆26Updated last year
• raymond1123 / hgemm
  ☆30Updated last year
• cqu20160901 / DETR_onnx_tensorRT_V2
  DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。
  ☆12Updated last year
• xuanandsix / Tensorrt-int8-quantization-pipline
  a simple pipline of int8 quantization based on tensorrt.
  ☆69Updated 3 years ago
• taishan1994 / LLM-Quantization
  记录量化LLM中的总结。
  ☆49Updated this week