DakeQQ / Native-LLM-for-Android
Demonstration of running a native LLM on Android device.
☆126Updated this week
Alternatives and similar repositories for Native-LLM-for-Android:
Users that are interested in Native-LLM-for-Android are comparing it to the libraries listed below
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆70Updated 11 months ago
- 参考自mlc-llm，个人尝试在android手机上部署大模型并运行☆85Updated 7 months ago
- llm-export can export llm model to onnx.☆274Updated 2 months ago
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆147Updated last year
- Run Chinese MobileBert model on SNPE.☆14Updated last year
- Demonstration of combine YOLO and depth estimation on Android device.☆42Updated this week
- stable diffusion using mnn☆65Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆60Updated this week
- 使用Android手机的CPU推理stable diffusion☆150Updated last year
- 使用Android cpu 运行 RWKV V4 ONNX☆70Updated last year
- GLM Series Edge Models☆131Updated last month
- A Toolkit to Help Optimize Onnx Model☆128Updated this week
- export llama to onnx☆118Updated 3 months ago
- ☆124Updated last year
- ☆218Updated last month
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆167Updated 2 weeks ago
- simplify >2GB large onnx model☆54Updated 4 months ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆67Updated 8 months ago
- ☆28Updated last year
- Port of Facebook's LLaMA model in C/C++☆92Updated this week
- segment anything model (SAM) infer by ncnn on Android mobile phone☆27Updated last year
- MiniCPM on Android platform.☆630Updated last week
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆240Updated 3 weeks ago
- A Toolkit to Help Optimize Large Onnx Model☆153Updated 10 months ago
- Run generative AI models in sophgo BM1684X☆190Updated this week
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆84Updated 2 years ago
- llm deploy project based onnx.☆35Updated 5 months ago
- Large Language Model Onnx Inference Framework☆32Updated 2 months ago
- This a demo of BlazeFace infer by ncnn☆91Updated 2 years ago