TroyTzou / mlc-llm-android
参考自mlc-llm，个人尝试在android手机上部署大模型并运行
☆85Updated 7 months ago
Alternatives and similar repositories for mlc-llm-android:
Users that are interested in mlc-llm-android are comparing it to the libraries listed below
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆70Updated 11 months ago
- 使用Android cpu 运行 RWKV V4 ONNX☆70Updated last year
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆147Updated last year
- Demonstration of running a native LLM on Android device.☆126Updated this week
- 使用Android手机的CPU推理stable diffusion☆150Updated last year
- MiniCPM on Android platform.☆630Updated last week
- llm-export can export llm model to onnx.☆272Updated 2 months ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆49Updated this week
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆67Updated 8 months ago
- ☆310Updated 3 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆238Updated 2 weeks ago
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆243Updated last year
- Phi3 中文仓库☆320Updated 4 months ago
- stable diffusion using mnn☆65Updated last year
- GLM Series Edge Models☆132Updated last month
- ☆218Updated last month
- a lightweight LLM model inference framework☆721Updated 11 months ago
- LLM101n: Let's build a Storyteller 中文版☆130Updated 7 months ago
- ☆28Updated 4 months ago
- 支持中文场景的的小语言模型 llama2.c-zh☆145Updated last year
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆223Updated 5 months ago
- Run Chinese MobileBert model on SNPE.☆14Updated last year
- ☆60Updated last year
- ☆123Updated last month
- Llama3-Chinese是以Meta-Llama-3-8B为底座，使用 DORA + LORA+ 的训练方法，在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。☆294Updated 11 months ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆193Updated 5 months ago
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…☆436Updated 2 weeks ago
- ☆137Updated 10 months ago
- Efficient inference of large language models.☆146Updated 3 months ago
- run ChatGLM2-6B in BM1684X☆49Updated last year