DakeQQ / Native-LLM-for-Android
Demonstration of running a native LLM on Android device.
☆71Updated this week
Related projects ⓘ
Alternatives and complementary repositories for Native-LLM-for-Android
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆48Updated 7 months ago
- Inference rwkv5 or rwkv6 with Qualcomm AI Engine Direct SDK☆37Updated last week
- 使用Android手机的CPU推理stable diffusion☆143Updated 11 months ago
- 参考自mlc-llm,个人尝试在android手机上部署大模型并运行☆64Updated 3 months ago
- 本项目是一个通过文字生成图片的项目,基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型,包括其配套的模型运行框架。☆108Updated 7 months ago
- stable diffusion using mnn☆63Updated last year
- 使用Android cpu 运行 RWKV V4 ONNX☆65Updated last year
- segment anything model (SAM) infer by ncnn on Android mobile phone☆27Updated last year
- ☆123Updated 11 months ago
- Port of Facebook's LLaMA model in C/C++☆71Updated last week
- qwen2 and llama3 cpp implementation☆34Updated 5 months ago
- simplify >2GB large onnx model☆44Updated 8 months ago
- a naive example of LivePortrait infer by ncnn☆34Updated 3 months ago
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆40Updated 9 months ago
- ☆82Updated last year
- libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙️💻☆56Updated last year
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 2 years ago
- 大模型部署实战:TensorRT-LLM, Triton Inference Server, vLLM☆26Updated 8 months ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆40Updated last year
- This a demo of BlazeFace infer by ncnn☆87Updated 2 years ago
- run ChatGLM2-6B in BM1684X☆48Updated 8 months ago
- llm-export can export llm model to onnx.☆230Updated last week
- an example of segment-anything infer by ncnn☆120Updated last year
- ncnn version of CodeFormer☆98Updated last year
- ☆28Updated 3 months ago
- ☆25Updated 11 months ago
- MiniCPM on Android platform.☆561Updated 7 months ago
- segment-anything based mnn☆34Updated 11 months ago
- DragGan in NCNN with c++☆46Updated last year
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆223Updated last year