TroyTzou / mlc-llm-android
参考自mlc-llm，个人尝试在android手机上部署大模型并运行
☆77Updated 6 months ago
Alternatives and similar repositories for mlc-llm-android:
Users that are interested in mlc-llm-android are comparing it to the libraries listed below
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆68Updated 10 months ago
- Demonstration of running a native LLM on Android device.☆112Updated this week
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆141Updated 10 months ago
- 使用Android cpu 运行 RWKV V4 ONNX☆68Updated last year
- llm-export can export llm model to onnx.☆263Updated last month
- 使用Android手机的CPU推理stable diffusion☆146Updated last year
- MiniCPM on Android platform.☆625Updated 10 months ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆60Updated 7 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆231Updated last week
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆204Updated 3 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆48Updated this week
- Port of Facebook's LLaMA model in C/C++☆84Updated 2 weeks ago
- ☆308Updated 2 months ago
- GLM Series Edge Models☆130Updated this week
- Chinese Community for Google Gemma LLM☆64Updated 11 months ago
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆239Updated last year
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 2 years ago
- ☆206Updated last week
- Run Chinese MobileBert model on SNPE.☆14Updated last year
- 首个llama2 13b 中文版模型 （Base + 中文对话SFT，实现流畅多轮人机自然语言交互)☆89Updated last year
- Inference RWKV v5, v6 and (WIP) v7 with Qualcomm AI Engine Direct SDK☆52Updated this week
- 支持中文场景的的小语言模型 llama2.c-zh☆145Updated 11 months ago
- 【逐条处理完成】人为审核+修改每一条的弱智吧精选问题QA数据集☆143Updated 2 weeks ago
- Llama3-Chinese是以Meta-Llama-3-8B为底座，使用 DORA + LORA+ 的训练方法，在50w高质量中文多轮SFT数据 + 10w 英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。☆295Updated 9 months ago
- pretrain a wiki llm using transformers☆25Updated 5 months ago
- 大模型推理框架加速，让 LLM 飞起来☆19Updated 9 months ago
- a lightweight LLM model inference framework☆717Updated 10 months ago
- stable diffusion using mnn☆65Updated last year
- Phi3 中文仓库☆323Updated 2 months ago
- ☆58Updated 11 months ago