Tao-begd / mlc-llm-android
参考自mlc-llm，个人尝试在android手机上部署大模型并运行
☆54Updated last month
Related projects: ⓘ
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆87Updated 5 months ago
- 使用Android cpu 运行 RWKV V4 ONNX☆65Updated last year
- Demonstration of running a native LLM on Android device.☆52Updated last week
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆40Updated 5 months ago
- MiniCPM on Android platform.☆521Updated 5 months ago
- 使用Android手机的CPU推理stable diffusion☆136Updated 9 months ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 2 years ago
- llm-export can export llm model to onnx.☆193Updated this week
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆130Updated 3 weeks ago
- a lightweight LLM model inference framework☆681Updated 5 months ago
- stable diffusion using mnn☆58Updated 11 months ago
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆210Updated last year
- ☆123Updated 9 months ago
- vits Android部署☆313Updated 5 months ago
- Run generative AI models in sophgo BM1684X☆103Updated this week
- run ChatGLM2-6B in BM1684X☆48Updated 6 months ago
- 支持中文场景的的小语言模型 llama2.c-zh☆140Updated 6 months ago
- C++ implementation of Qwen-LM☆531Updated 8 months ago
- Inference rwkv5 or rwkv6 with Qualcomm AI Engine Direct SDK☆33Updated this week
- Low-bit LLM inference on CPU with lookup table☆440Updated this week
- Efficient inference of large language models.☆137Updated last week
- LLM101n: Let's build a Storyteller 中文版☆113Updated last month
- This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit…☆227Updated this week
- ☆425Updated last year
- Phi3 中文 仓库☆314Updated 4 months ago
- Port of Facebook's LLaMA model in C/C++☆66Updated this week
- ☆81Updated last year
- OrionStar-Yi-34B-Chat 是一款开源中英文Chat模型，由猎户星空基于Yi-34B开源模型、使用15W+高质量语料微调而成。☆260Updated 5 months ago
- qwen2 and llama3 cpp implementation☆34Updated 3 months ago
- ☆20Updated 10 months ago