TroyTzou / mlc-llm-androidLinks
参考自mlc-llm,个人尝试在android手机上部署大模型并运行
☆86Updated 10 months ago
Alternatives and similar repositories for mlc-llm-android
Users that are interested in mlc-llm-android are comparing it to the libraries listed below
Sorting:
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆79Updated last year
- Demonstration of running a native LLM on Android device.☆146Updated 2 weeks ago
- 使用Android cpu 运行 RWKV V4 ONNX☆68Updated last year
- 本项目是一个通过文字生成图片的项目,基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型,包括其配套的模型运行框架。☆202Updated last year
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆255Updated last year
- MiniCPM on Android platform.☆630Updated 3 months ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆73Updated 11 months ago
- llm-export can export llm model to onnx.☆295Updated 5 months ago
- ☆146Updated last year
- Phi3 中文后训练模型仓库☆321Updated 6 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆52Updated last week
- GLM Series Edge Models☆142Updated 2 weeks ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆208Updated 8 months ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- Chinese Community for Google Gemma LLM☆63Updated last year
- chineseocr lite android onnx ,超轻量级中文ocr android demo,支持竖排文字识别, 支持onnx推理(psenet+anglenet+crnn)☆51Updated 2 years ago
- ☆457Updated last year
- a lightweight LLM model inference framework☆730Updated last year
- run chatglm3-6b in BM1684X☆39Updated last year
- LLM101n: Let's build a Storyteller 中文版☆131Updated 10 months ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 3 years ago
- 支持中文场景的的小语言模型 llama2.c-zh☆147Updated last year
- A prompt set of ChatGLM-6B☆14Updated last year
- ☆310Updated 6 months ago
- Port of Facebook's LLaMA model in C/C++☆96Updated 2 weeks ago
- ☆63Updated last year
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆80Updated last month
- MiniCPM on iOS.☆68Updated 3 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆256Updated 3 weeks ago
- ☆233Updated 4 months ago