Alternatives and similar repositories for mlc-llm-android:

Users that are interested in mlc-llm-android are comparing it to the libraries listed below

• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆62Updated 9 months ago
• XiaoMi / StableDiffusionOnDevice
  本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。
  ☆131Updated 9 months ago
• ZTMIDGO / RWKV-Android
  使用Android cpu 运行 RWKV V4 ONNX
  ☆68Updated last year
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆105Updated 3 weeks ago
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆257Updated this week
• OpenBMB / mlc-MiniCPM
  MiniCPM on Android platform.
  ☆622Updated 9 months ago
• modelscope / dash-infer
  DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …
  ☆213Updated this week
• MegEngine / InferLLM
  a lightweight LLM model inference framework
  ☆713Updated 9 months ago
• THUDM / GLM-Edge
  GLM Series Edge Models
  ☆124Updated 2 weeks ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆146Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated 10 months ago
• infinigence / Infini-Megrez
  ☆303Updated last month
• infinigence / Infini-Megrez-Omni
  ☆198Updated last month
• XiaoMi / MiLM-6B
  ☆445Updated last year
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆59Updated 6 months ago
• OpenBMB / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆77Updated this week
• OpenBMB / MiniCPM-CookBook
  This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…
  ☆180Updated 2 months ago
• GemmaLab / GemmaChinese
  Chinese Community for Google Gemma LLM
  ☆64Updated 10 months ago
• EdVince / CLIP-ImageSearch-NCNN
  CLIP⚡NCNN⚡基于自然语言的图片搜索(Image Search)⚡以字搜图⚡x86⚡Android
  ☆236Updated last year
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆121Updated 5 months ago
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆65Updated last year
• chenyangMl / llama2.c-zh
  支持中文场景的的小语言模型 llama2.c-zh
  ☆145Updated 10 months ago
• zhaibowen / Retriever
  Retriever-0.1B
  ☆79Updated 7 months ago
• open-chinese / alpaca-chinese-dataset
  Alpaca Chinese Dataset -- 中文指令微调数据集【人工+GPT4o持续更新】
  ☆193Updated 3 months ago
• 2404589803 / hf-daily-paper-newsletter-chinese
  🔥Your Daily Dose of AI Research from Hugging Face 🔥 Stay updated with the latest AI breakthroughs! This bot automatically collects and…
  ☆40Updated this week
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆570Updated last month
• zRzRzRzRzRzRzR / lm-fly
  大模型推理框架加速，让 LLM 飞起来
  ☆18Updated 8 months ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and (WIP) v7 with Qualcomm AI Engine Direct SDK
  ☆47Updated this week
• luchangli03 / onnxsim_large_model
  simplify >2GB large onnx model
  ☆51Updated last month
• liguodongiot / unify-easy-llm
  unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。
  ☆53Updated 5 months ago