TroyTzou / mlc-llm-androidLinks
参考自mlc-llm,个人尝试在android手机上部署大模型并运行
☆86Updated 10 months ago
Alternatives and similar repositories for mlc-llm-android
Users that are interested in mlc-llm-android are comparing it to the libraries listed below
Sorting:
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆79Updated last year
- 本项目是一个通过文字生成图片的项目,基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型,包括其配套的模型运行框架。☆196Updated last year
- Demonstration of running a native LLM on Android device.☆142Updated last week
- 使用Android cpu 运行 RWKV V4 ONNX☆69Updated last year
- MiniCPM on Android platform.☆631Updated 2 months ago
- llm-export can export llm model to onnx.☆293Updated 4 months ago
- CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android☆253Updated last year
- 🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…☆51Updated this week
- GLM Series Edge Models☆142Updated 3 months ago
- a lightweight LLM model inference framework☆728Updated last year
- 支持中文场景的的小语言模型 llama2.c-zh☆147Updated last year
- run ChatGLM2-6B in BM1684X☆49Updated last year
- LLM101n: Let's build a Storyteller 中文版☆131Updated 9 months ago
- GPT2⚡NCNN⚡中文对话⚡x86⚡Android☆79Updated 3 years ago
- ☆310Updated 5 months ago
- 想要从零开始训练一个中文的mini大语言模型,可以进行基本的对话,模型大小根据手头的机器决定☆59Updated 9 months ago
- ☆458Updated last year
- Alpaca Chinese Dataset -- 中文指令微调数据集☆205Updated 8 months ago
- 中文Mixtral混合专家大模型(Chinese Mixtral MoE LLMs)☆606Updated last year
- LLM inference in C/C++☆41Updated last week
- Efficient inference of large language models.☆148Updated this week
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆254Updated last week
- export llama to onnx☆124Updated 5 months ago
- ☆144Updated last year
- Port of Facebook's LLaMA model in C/C++☆94Updated 3 weeks ago
- stable diffusion using mnn☆68Updated last year
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆72Updated 11 months ago
- ☆231Updated 3 months ago
- ☆60Updated last year
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆68Updated last week