TroyTzou / mlc-llm-androidLinks
参考自mlc-llm，个人尝试在android手机上部署大模型并运行
☆87Updated 11 months ago
Alternatives and similar repositories for mlc-llm-android
Users that are interested in mlc-llm-android are comparing it to the libraries listed below
Sorting:
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆80Updated last year
- 使用Android cpu 运行 RWKV V4 ONNX☆68Updated last year
- Demonstration of running a native LLM on Android device.☆151Updated this week
- MiniCPM on Android platform.☆635Updated 3 months ago
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆204Updated last year
- a lightweight LLM model inference framework☆731Updated last year
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆259Updated 2 years ago
- llm-export can export llm model to onnx.☆300Updated 6 months ago
- C++ implementation of Qwen-LM☆596Updated 7 months ago
- ☆455Updated last year
- ☆314Updated 7 months ago
- GLM Series Edge Models☆144Updated last month
- 支持中文场景的的小语言模型 llama2.c-zh☆147Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆74Updated last year
- 为MNN安卓端适配兼容openai的API接口☆16Updated 2 months ago
- workbench for learning and practicing on-device AI technology in real scenario with online-TV on Android phone, powered by ggml(llama.cpp…☆168Updated last month
- Port of Facebook's LLaMA model in C/C++☆97Updated this week
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆52Updated this week
- Phi3 中文后训练模型仓库☆321Updated 7 months ago
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆255Updated 2 weeks ago
- Chinese Community for Google Gemma LLM☆63Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆75Updated this week
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆259Updated last month
- Llama3-Chinese是以Meta-Llama-3-8B为底座，使用 DORA + LORA+ 的训练方法，在50w高质量中文多轮SFT数据 + 10w英文多轮SFT数据 + 2000单轮自我认知数据训练而来的大模型。☆295Updated last year
- chineseocr lite android onnx ，超轻量级中文ocr android demo，支持竖排文字识别, 支持onnx推理(psenet+anglenet+crnn)☆52Updated 2 years ago
- llm deploy project based mnn. This project has merged into MNN.☆1,597Updated 5 months ago
- 大模型中文测试题库-民间版本☆84Updated 2 years ago
- Yuan 2.0 Large Language Model☆688Updated last year
- LLM inference in C/C++☆42Updated this week
- ☆232Updated 4 months ago