Demonstration of running a native LLM on Android device.
☆255Jun 7, 2026Updated this week
Alternatives and similar repositories for Native-LLM-for-Android
Users that are interested in Native-LLM-for-Android are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Utilizes ONNX Runtime for audio denoising.☆130Updated this week
- Utilizes ONNX Runtime to transcribe audio into text.☆84Updated this week
- 基于MNN-llm 的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆97Apr 8, 2024Updated 2 years ago
- ☆18Dec 7, 2023Updated 2 years ago
- Utilizes ONNX Runtime for TTS model.☆64Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Let's use Qualcomm NPU in Android☆20Feb 18, 2025Updated last year
- IRIS is an android app for interfacing with GGUF / llama.cpp models locally.☆280Feb 1, 2025Updated last year
- llm deploy project based onnx.☆49Oct 9, 2024Updated last year
- llm-export can export llm model to onnx.☆352May 8, 2026Updated last month
- A basic startup guide on running LLMs on android locally or using an external ollama server☆38Jan 31, 2024Updated 2 years ago
- Export the STFT or ISTFT process in ONNX format.☆44Updated this week
- Fast Multimodal LLM on Mobile Devices☆1,532Apr 30, 2026Updated last month
- Large Language Model Onnx Inference Framework☆35Nov 25, 2025Updated 6 months ago
- ffmpeg+cuvid+tensorrt+multicamera☆12Dec 31, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆24Feb 4, 2025Updated last year
- Running the F5-TTS by ONNX Runtime☆198Updated this week
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆20Sep 12, 2024Updated last year
- ☆44Mar 18, 2026Updated 2 months ago
- ☆23Jan 3, 2024Updated 2 years ago
- 参考自mlc-llm，个人尝试在android手机上部署大模型并运行☆90Aug 5, 2024Updated last year
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- The repository supports TensorRT, QNN platform inference, 2D obstacle detection yolo series (yolov5, yolov8, yolo11, yolox), semantic seg…☆20May 6, 2025Updated last year
- segment-anything based mnn☆37Dec 13, 2023Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆93May 24, 2026Updated 2 weeks ago
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆68Sep 22, 2024Updated last year
- A mobile Implementation of llama.cpp☆328Feb 1, 2024Updated 2 years ago
- stable diffusion using mnn☆68Sep 28, 2023Updated 2 years ago
- Audio driven video synthesis☆40Aug 11, 2022Updated 3 years ago
- Support PyTorch model conversion with LiteRT.☆1,044Updated this week
- pre-training llama3 using chinese☆13May 1, 2024Updated 2 years ago
- ☆33Jul 23, 2024Updated last year
- Chinese and English Bilinguish G2P☆22Jul 16, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Spliting the ASR probability distribution results into the chinese pinyin, so as to extract more effective feature for the chinese speech…☆21Mar 16, 2023Updated 3 years ago
- ☆28Jun 30, 2025Updated 11 months ago
- ☆17Oct 16, 2023Updated 2 years ago
- Intelligent Android Keyboard: Utilising OpenAI's LLM API for context-aware text suggestions and customisable prompts, enhancing user typi…☆36May 8, 2023Updated 3 years ago
- Real-time speech recognition and voice activity detection (VAD) using next-gen Kaldi with ncnn without Internet connection. Support iOS, …☆1,739Oct 20, 2025Updated 7 months ago
- Voice Craft is a desktop AI assistance tool designed to help people with disabilities operate a computer using their voice. This tool can…☆18May 23, 2023Updated 3 years ago
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆170Jun 3, 2026Updated last week