Alternatives and similar repositories for binary-mlc-llm-libs

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆320Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆133Updated 5 months ago
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆237Updated 8 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆26Updated 2 years ago
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆635Updated 7 months ago
• mbzuai-oryx / MobiLlama
  [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices
  ☆663Updated 5 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆160Updated 5 months ago
• rupeshs / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)
  ☆262Updated 2 years ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆214Updated last week
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆130Updated 2 months ago
• shubham0204 / SmolChat-Android
  Running any GGUF SLMs/LLMs locally, on-device in Android
  ☆546Updated last month
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• BrutalCoding / shady.ai
  Making offline AI models accessible to all types of edge devices.
  ☆142Updated last year
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆455Updated 2 years ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆92Updated last week
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆126Updated last year
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,550Updated 7 months ago
• NexaAI / octopus-v4
  AI for all: Build the large graph of the language models
  ☆276Updated last year
• marty1885 / llama.cpp
  My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend
  ☆107Updated last week
• Ac1drainn / OllamaDroid
  A Ollama client for Android!
  ☆86Updated last year
• Manuel030 / llama2.c-android
  Inference Llama 2 in one file of pure C
  ☆43Updated 2 years ago
• zkh2016 / LLMFarm
  MiniCPM on iOS.
  ☆67Updated 7 months ago
• Lisoveliy / StarCoderEx
  Extension for using alternative GitHub Copilot (StarCoder API) in VSCode
  ☆100Updated last year
• dbpunk-labs / octogen
  Octogen is an Open-Source Code Interpreter Agent Framework
  ☆257Updated last year
• xNul / code-llama-for-vscode
  Use Code Llama with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
  ☆569Updated last year
• LucienShui / huggingface-vscode-endpoint-server
  starcoder server for huggingface-vscdoe custom endpoint
  ☆175Updated last year
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆191Updated last month
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆727Updated this week
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆494Updated last year