Demonstration of running a native LLM on Android device.
☆236Mar 14, 2026Updated last week
Alternatives and similar repositories for Native-LLM-for-Android
Users that are interested in Native-LLM-for-Android are comparing it to the libraries listed below
Sorting:
- Demonstration of combine YOLO and depth estimation on Android device.☆68Nov 15, 2025Updated 4 months ago
- Utilizes ONNX Runtime for audio denoising.☆116Dec 27, 2025Updated 2 months ago
- Utilizes ONNX Runtime for speech activity detection.☆42Dec 10, 2025Updated 3 months ago
- Transcribe subtitles and translate them offline with ease.☆40Jan 10, 2026Updated 2 months ago
- Demonstrate Yolov9 model with Qualcomm Hexagon NPU and DirectML☆12Nov 27, 2024Updated last year
- Utilizes ONNX Runtime to transcribe audio into text.☆81Updated this week
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆90Apr 8, 2024Updated last year
- ☆16Dec 7, 2023Updated 2 years ago
- Run pytorch models on GPU Android with Vulkan backend☆10Aug 15, 2023Updated 2 years ago
- IRIS is an android app for interfacing with GGUF / llama.cpp models locally.☆268Feb 1, 2025Updated last year
- llm deploy project based onnx.☆49Oct 9, 2024Updated last year
- Android本地运行mnn-llm语言模型简单示例☆13Oct 2, 2025Updated 5 months ago
- llm-export can export llm model to onnx.☆344Oct 24, 2025Updated 4 months ago
- A basic startup guide on running LLMs on android locally or using an external ollama server☆35Jan 31, 2024Updated 2 years ago
- Export the STFT or ISTFT process in ONNX format.☆41Updated this week
- Fast Multimodal LLM on Mobile Devices☆1,437Updated this week
- Running the F5-TTS by ONNX Runtime standalone with GUI☆24Dec 10, 2024Updated last year
- mnn asr demo.☆25Mar 24, 2025Updated 11 months ago
- Large Language Model Onnx Inference Framework☆34Nov 25, 2025Updated 3 months ago
- ffmpeg+cuvid+tensorrt+multicamera☆11Dec 31, 2024Updated last year
- ☆25Mar 10, 2026Updated last week
- Memory Cleaner, Phone Booster and Optimizer.☆10Nov 20, 2018Updated 7 years ago
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆22Feb 4, 2025Updated last year
- Android app for the Hole in your Palm project, making LLMs accessible on-device!☆18May 3, 2024Updated last year
- Running the F5-TTS by ONNX Runtime☆193Jan 7, 2026Updated 2 months ago
- ☆23Jan 3, 2024Updated 2 years ago
- llm deploy project based mnn. This project has merged into MNN.☆1,617Jan 20, 2025Updated last year
- PersonaTalk Hack☆15Jan 10, 2025Updated last year
- ☆16Mar 28, 2024Updated last year
- 参考自mlc-llm，个人尝试在android手机上部署大模型并运行☆91Aug 5, 2024Updated last year
- HunyuanDiT with TensorRT and libtorch☆17May 22, 2024Updated last year
- The repository supports TensorRT, QNN platform inference, 2D obstacle detection yolo series (yolov5, yolov8, yolo11, yolox), semantic seg…☆19May 6, 2025Updated 10 months ago
- segment-anything based mnn☆35Dec 13, 2023Updated 2 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆90Feb 14, 2026Updated last month
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆66Sep 22, 2024Updated last year
- A mobile Implementation of llama.cpp☆327Feb 1, 2024Updated 2 years ago
- stable diffusion using mnn☆66Sep 28, 2023Updated 2 years ago
- Support PyTorch model conversion with LiteRT.☆958Updated this week
- Audio driven video synthesis☆40Aug 11, 2022Updated 3 years ago