Alternatives and similar repositories for binary-mlc-llm-libs

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆321Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆134Updated 6 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆214Updated 3 weeks ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆158Updated last year
• mbzuai-oryx / MobiLlama
  [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices
  ☆664Updated 6 months ago
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆95Updated last month
• zkh2016 / LLMFarm
  MiniCPM on iOS.
  ☆67Updated 7 months ago
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆56Updated 8 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆74Updated last year
• ggml-org / p1
  LLM-based code completion engine
  ☆190Updated 9 months ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆455Updated 2 years ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆272Updated this week
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆636Updated 7 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆146Updated last year
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆284Updated last year
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆132Updated 3 months ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆26Updated 2 years ago
• BrutalCoding / shady.ai
  Making offline AI models accessible to all types of edge devices.
  ☆142Updated last year
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆327Updated 3 weeks ago
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆178Updated 3 weeks ago
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated last year
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated last year
• mmwillet / TTS.cpp
  TTS support with GGML
  ☆193Updated last month
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆740Updated last week
• QuixiAI / OpenChatML
  ☆163Updated 3 months ago
• Cornell-RelaxML / quip-sharp
  ☆565Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆83Updated last year
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,553Updated 7 months ago