quic / ai-hub-appsLinks
The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
☆345Updated this week
Alternatives and similar repositories for ai-hub-apps
Users that are interested in ai-hub-apps are comparing it to the libraries listed below
Sorting:
- The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.)…☆849Updated 2 weeks ago
- Supporting PyTorch models with the Google AI Edge TFLite runtime.☆855Updated this week
- ☆168Updated 3 weeks ago
- LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via e…☆1,035Updated this week
- Demonstration of running a native LLM on Android device.☆202Updated this week
- LLM inference in C/C++☆48Updated this week
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆92Updated this week
- Fast Multimodal LLM on Mobile Devices☆1,221Updated this week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆381Updated this week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆88Updated this week
- ☆41Updated 8 months ago
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆68Updated last year
- Generative AI extensions for onnxruntime☆901Updated this week
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆178Updated 5 months ago
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆35Updated 4 months ago
- 本项目是一个通过文字生成图片的项目,基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型,包括其配套的模型运行框架。☆227Updated last year
- llama.cpp tutorial on Android phone☆137Updated 7 months ago
- Awesome Mobile LLMs☆276Updated last week
- Low-bit LLM inference on CPU/NPU with lookup table☆898Updated 6 months ago
- Demonstration of combine YOLO and depth estimation on Android device.☆61Updated 3 weeks ago
- A Toolkit to Help Optimize Onnx Model☆267Updated this week
- Let's use Qualcomm NPU in Android☆15Updated 9 months ago
- Example apps and demos using PyTorch's ExecuTorch framework☆40Updated 3 weeks ago
- llm-export can export llm model to onnx.☆333Updated last month
- High-speed and easy-use LLM serving framework for local deployment☆137Updated 4 months ago
- On-device AI across mobile, embedded and edge for PyTorch☆3,634Updated this week
- IRIS is an android app for interfacing with GGUF / llama.cpp models locally.☆252Updated 10 months ago
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆85Updated last year
- ☆11Updated last month
- Run Chinese MobileBert model on SNPE.☆15Updated 2 years ago