Alternatives and similar repositories for binary-mlc-llm-libs

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆138Updated 7 months ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆323Updated last year
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆257Updated 10 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆130Updated 2 years ago
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆634Updated 9 months ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆26Updated 2 years ago
• mbzuai-oryx / MobiLlama
  [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices
  ☆668Updated 7 months ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆157Updated 2 years ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆166Updated 7 months ago
• shubham0204 / SmolChat-Android
  Running any GGUF SLMs/LLMs locally, on-device in Android
  ☆615Updated 3 weeks ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆457Updated 2 years ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆139Updated 4 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆218Updated this week
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆273Updated last week
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆76Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated 11 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆248Updated last year
• Lisoveliy / StarCoderEx
  Extension for using alternative GitHub Copilot (StarCoder API) in VSCode
  ☆100Updated last year
• Cornell-RelaxML / quip-sharp
  ☆574Updated last year
• rupeshs / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)
  ☆263Updated 2 years ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆96Updated 2 months ago
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,554Updated 9 months ago
• iohub / collama
  VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.
  ☆183Updated 10 months ago
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 10 months ago
• randaller / llama-cpu
  Inference on CPU code for LLaMA models
  ☆137Updated 2 years ago
• zkh2016 / LLMFarm
  MiniCPM on iOS.
  ☆67Updated 9 months ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆351Updated last year
• petals-infra / chat.petals.dev
  💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
  ☆316Updated last year
• QuixiAI / OpenChatML
  ☆164Updated 4 months ago
• quic / ai-hub-apps
  The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…
  ☆350Updated last week