DakeQQ / Native-LLM-for-Android
Demonstration of running a native LLM on Android device.
☆136Updated this week
Alternatives and similar repositories for Native-LLM-for-Android
Users that are interested in Native-LLM-for-Android are comparing it to the libraries listed below
Sorting:
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆77Updated last year
- 参考自mlc-llm,个人尝试在android手机上部署大模型并运行☆86Updated 9 months ago
- 本项目是一个通过文字生成图片的项目,基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型,包括其配套的模型运行框架。☆188Updated last year
- llm-export can export llm model to onnx.☆286Updated 3 months ago
- MiniCPM on Android platform.☆630Updated last month
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆189Updated this week
- 使用Android手机的CPU推理stable diffusion☆152Updated last year
- Demonstration of combine YOLO and depth estimation on Android device.☆47Updated this week
- stable diffusion using mnn☆68Updated last year
- Run Chinese MobileBert model on SNPE.☆14Updated last year
- Utilizes ONNX Runtime to transcribe audio into text.☆26Updated this week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆64Updated last week
- Port of Facebook's LLaMA model in C/C++☆93Updated last week
- ☆84Updated 2 years ago
- A Toolkit to Help Optimize Onnx Model☆145Updated this week
- segment anything model (SAM) infer by ncnn on Android mobile phone☆27Updated last year
- 使用Android cpu 运行 RWKV V4 ONNX☆70Updated last year
- Android app for running transformers locally using LLama.cpp & Whisper.cpp☆26Updated 10 months ago
- ☆29Updated last year
- export llama to onnx☆124Updated 4 months ago
- ☆124Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆72Updated 10 months ago
- an example of segment-anything infer by ncnn☆121Updated 2 years ago
- Run generative AI models in sophgo BM1684X/BM1688☆208Updated this week
- 端到端语音唤醒工具箱,从模型训练到模型推理。☆113Updated 8 months ago
- ☆226Updated 2 months ago
- A converter for llama2.c legacy models to ncnn models.☆87Updated last year
- facebook faiss for android☆46Updated 4 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- llama.cpp tutorial on Android phone☆101Updated last week