Alternatives and similar repositories for binary-mlc-llm-libs

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆124Updated 3 months ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆315Updated last year
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆233Updated 6 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆196Updated this week
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆677Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆82Updated this week
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆457Updated last year
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆158Updated 3 months ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆158Updated last year
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆634Updated 5 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆216Updated 11 months ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆278Updated last year
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web
  ☆263Updated 2 weeks ago
• rupeshs / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)
  ☆265Updated 2 years ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆116Updated 3 weeks ago
• QuixiAI / OpenChatML
  ☆161Updated 2 weeks ago
• LucienShui / huggingface-vscode-endpoint-server
  starcoder server for huggingface-vscdoe custom endpoint
  ☆173Updated last year
• mbzuai-oryx / MobiLlama
  [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices
  ☆655Updated 3 months ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆149Updated 2 years ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆106Updated last year
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆492Updated last year
• google-ai-edge / LiteRT-LM
  ☆306Updated this week
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆75Updated 10 months ago
• clcarwin / alpaca-weight
  Train llama with lora on one 4090 and merge weight of lora to work as stanford alpaca.
  ☆52Updated 2 years ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated 11 months ago
• randaller / llama-cpu
  Inference on CPU code for LLaMA models
  ☆137Updated 2 years ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated last year