TroyTzou / mlc-llm-androidLinks
参考自mlc-llm,个人尝试在android手机上部署大模型并运行
☆88Updated last year
Alternatives and similar repositories for mlc-llm-android
Users that are interested in mlc-llm-android are comparing it to the libraries listed below
Sorting:
- 使用Android cpu 运行 RWKV V4 ONNX☆68Updated 2 years ago
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆82Updated last year
- Demonstration of running a native LLM on Android device.☆161Updated this week
- MiniCPM on Android platform.☆636Updated 4 months ago
- 本项目是一个通过文字生成图片的项目,基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型,包括其配套的模型运行框架。☆211Updated last year
- a lightweight LLM model inference framework☆734Updated last year
- ☆454Updated 2 years ago
- llm-export can export llm model to onnx.☆301Updated 6 months ago
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆259Updated 2 years ago
- Phi3 中文后训练模型仓库☆321Updated 8 months ago
- ☆325Updated 2 weeks ago
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆53Updated this week
- Port of Facebook's LLaMA model in C/C++☆98Updated this week
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆171Updated last month
- C++ implementation of Qwen-LM☆604Updated 8 months ago
- 【逐条处理完成】人为审核+修改每一条的弱智吧精选问题QA数据集☆216Updated 3 months ago
- 支持中文场景的的小语言模型 llama2.c-zh☆148Updated last year
- BlueLM(蓝心大模型): Open large language models developed by vivo AI Lab☆922Updated 7 months ago
- GLM Series Edge Models☆146Updated last month
- Llama3-Chinese是以Meta-Llama-3-8B为底座,使用 DORA + LORA+ 的训练方法,在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。☆295Updated last year
- llm deploy project based mnn. This project has merged into MNN.☆1,601Updated 6 months ago
- LLM101n: Let's build a Storyteller 中文版☆132Updated 11 months ago
- Retriever-0.1B☆93Updated last year
- Alpaca Chinese Dataset -- 中文指令微调数据集☆210Updated 10 months ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆77Updated this week
- OrionStar-Yi-34B-Chat 是一款开源中英文Chat模型,由猎户星空基于Yi-34B开源模型、使用15W+高质量语料微调而成。☆260Updated last year
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型,支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆561Updated last year
- 中文Mixtral混合专家大模型(Chinese Mixtral MoE LLMs)☆607Updated last year
- 为MNN安卓端适配兼容openai的API接口☆17Updated 3 months ago
- stable diffusion using mnn☆66Updated last year