TroyTzou / mlc-llm-android
参考自mlc-llm，个人尝试在android手机上部署大模型并运行
☆86Updated 9 months ago
Alternatives and similar repositories for mlc-llm-android
Users that are interested in mlc-llm-android are comparing it to the libraries listed below
Sorting:
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆77Updated last year
- Demonstration of running a native LLM on Android device.☆136Updated this week
- 使用Android cpu 运行 RWKV V4 ONNX☆70Updated last year
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆184Updated last year
- MiniCPM on Android platform.☆630Updated last month
- 使用Android手机的CPU推理stable diffusion☆152Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆72Updated 10 months ago
- llm-export can export llm model to onnx.☆286Updated 3 months ago
- 为MNN安卓端适配兼容openai的API接口☆11Updated 3 weeks ago
- Phi3 中文后训练模型仓库☆321Updated 5 months ago
- a lightweight LLM model inference framework☆728Updated last year
- run chatglm3-6b in BM1684X☆38Updated last year
- run ChatGLM2-6B in BM1684X☆49Updated last year
- ☆310Updated 4 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆51Updated this week
- Alpaca Chinese Dataset -- 中文指令微调数据集☆200Updated 7 months ago
- GLM Series Edge Models☆138Updated 2 months ago
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆251Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆64Updated this week
- chineseocr lite android onnx ，超轻量级中文ocr android demo，支持竖排文字识别, 支持onnx推理(psenet+anglenet+crnn)☆50Updated 2 years ago
- vits Android部署☆334Updated last year
- Chinese Community for Google Gemma LLM☆64Updated last year
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 3 years ago
- ☆142Updated 11 months ago
- Port of Facebook's LLaMA model in C/C++☆93Updated this week
- 【逐条处理完成】人为审核+修改每一条的弱智吧精选问题QA数据集☆197Updated last month
- 一个模块化，全过程可离线，低占用率的对话机器人/智能音箱☆76Updated 2 months ago
- llm deploy project based mnn. This project has merged into MNN.☆1,577Updated 3 months ago
- Run Chinese MobileBert model on SNPE.☆14Updated last year
- ☆59Updated last year