DakeQQ / Native-LLM-for-Android
Demonstration of running a native LLM on Android device.
☆112Updated this week
Alternatives and similar repositories for Native-LLM-for-Android:
Users that are interested in Native-LLM-for-Android are comparing it to the libraries listed below
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆68Updated 10 months ago
- 本项目是一个通过文字生成图片的项目,基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型,包括其配套的模型运行框架。☆141Updated 10 months ago
- 参考自mlc-llm,个人尝试在android手机上部署大模型并运行☆77Updated 6 months ago
- 使用Android手机的CPU推理stable diffusion☆146Updated last year
- Run Chinese MobileBert model on SNPE.☆14Updated last year
- Port of Facebook's LLaMA model in C/C++☆84Updated 2 weeks ago
- Demonstration of combine YOLO and depth estimation on Android device.☆36Updated this week
- llm-export can export llm model to onnx.☆263Updated last month
- ☆27Updated last year
- MiniCPM on Android platform.☆625Updated 10 months ago
- Android app for running transformers locally using LLama.cpp & Whisper.cpp☆27Updated 8 months ago
- Inference RWKV v5, v6 and (WIP) v7 with Qualcomm AI Engine Direct SDK☆52Updated this week
- stable diffusion using mnn☆65Updated last year
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆140Updated 3 weeks ago
- ☆54Updated last month
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆60Updated 7 months ago
- segment anything model (SAM) infer by ncnn on Android mobile phone☆27Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆41Updated last year
- 使用Android cpu 运行 RWKV V4 ONNX☆68Updated last year
- mnn yolo demos.☆64Updated 4 months ago
- ☆84Updated last year
- ☆30Updated 10 months ago
- a naive example of LivePortrait infer by ncnn☆41Updated 6 months ago
- chineseocr lite android onnx ,超轻量级中文ocr android demo,支持竖排文字识别, 支持onnx推理(psenet+anglenet+crnn)☆47Updated 2 years ago
- facebook faiss for android☆43Updated 4 years ago
- GLM Series Edge Models☆130Updated this week
- qwen2 and llama3 cpp implementation☆40Updated 8 months ago
- A Toolkit to Help Optimize Onnx Model☆114Updated 3 weeks ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 2 years ago