TroyTzou / mlc-llm-androidLinks
参考自mlc-llm，个人尝试在android手机上部署大模型并运行
☆90Updated last year
Alternatives and similar repositories for mlc-llm-android
Users that are interested in mlc-llm-android are comparing it to the libraries listed below
Sorting:
- 使用Android cpu 运行 RWKV V4 ONNX☆69Updated 2 years ago
- MiniCPM on Android platform.☆635Updated 6 months ago
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆84Updated last year
- Demonstration of running a native LLM on Android device.☆184Updated 3 weeks ago
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆219Updated last year
- a lightweight LLM model inference framework☆738Updated last year
- 使用Android手机的CPU推理stable diffusion☆159Updated last year
- llm deploy project based mnn. This project has merged into MNN.☆1,605Updated 8 months ago
- C++ implementation of Qwen-LM☆607Updated 10 months ago
- llm-export can export llm model to onnx.☆313Updated last month
- GLM Series Edge Models☆149Updated 3 months ago
- 支持中文场景的的小语言模型 llama2.c-zh☆150Updated last year
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆268Updated 2 years ago
- ☆453Updated 2 years ago
- ☆333Updated 2 weeks ago
- OrionStar-Yi-34B-Chat 是一款开源中英文Chat模型，由猎户星空基于Yi-34B开源模型、使用15W+高质量语料微调而成。☆261Updated last year
- Phi3 中文后训练模型仓库☆323Updated 10 months ago
- hf-mirror-cli 使用国内镜像，无需配置开箱即用，快速下载hugingface上的模型☆142Updated 7 months ago
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆177Updated 3 months ago
- Efficient AI Inference & Serving☆478Updated last year
- Llama3-Chinese是以Meta-Llama-3-8B为底座，使用 DORA + LORA+ 的训练方法，在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。☆296Updated last year
- 中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）☆609Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆80Updated last year
- Port of Facebook's LLaMA model in C/C++☆101Updated this week
- ☆239Updated 7 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆265Updated 2 months ago
- vits Android部署☆342Updated last year
- Yuan 2.0 Large Language Model☆688Updated last year
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆293Updated 3 months ago
- ☆256Updated last month