Alternatives and similar repositories for binary-mlc-llm-libs

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆312Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆110Updated last month
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆216Updated 4 months ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆152Updated last year
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆86Updated 10 months ago
• mlc-ai / relax
  ☆158Updated last week
• microsoft / WizardLM2
  ☆59Updated last year
• Cornell-RelaxML / quip-sharp
  ☆541Updated 7 months ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆249Updated 2 weeks ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆302Updated 2 years ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆184Updated last week
• MegEngine / InferLLM
  a lightweight LLM model inference framework
  ☆730Updated last year
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆72Updated 8 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆126Updated 2 years ago
• alex-vt / WhisperInput
  Offline voice input panel & keyboard with punctuation for Android.
  ☆105Updated last year
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆172Updated 2 weeks ago
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆204Updated 3 weeks ago
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,529Updated 3 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆453Updated last year
• rupeshs / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)
  ☆263Updated 2 years ago
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆79Updated last year
• OpenGVLab / EfficientQAT
  [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆273Updated last month
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 4 months ago
• MikeBirdTech / open-interpreter-termux
  Instructions for installing Open Interpreter on your Android device.
  ☆225Updated last year
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆594Updated 6 months ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• mlc-ai / llm-perf-bench
  ☆118Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• Mobile-Artificial-Intelligence / maid
  Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.
  ☆2,046Updated 3 weeks ago