Alternatives and similar repositories for binary-mlc-llm-libs

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆319Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆128Updated 4 months ago
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆235Updated 7 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆129Updated 2 years ago
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆56Updated 6 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆247Updated last year
• mbzuai-oryx / MobiLlama
  [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices
  ☆660Updated 4 months ago
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆159Updated 4 months ago
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆634Updated 5 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆200Updated this week
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆456Updated 2 years ago
• menloresearch / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 11 months ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆159Updated last year
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆348Updated last year
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆375Updated last year
• BrutalCoding / shady.ai
  Making offline AI models accessible to all types of edge devices.
  ☆145Updated last year
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• QuixiAI / OpenChatML
  ☆161Updated last month
• NVIDIA / trt-llm-as-openai-windows
  This reference can be used with any existing OpenAI integrated apps to run with TRT-LLM inference locally on GeForce GPU on Windows inste…
  ☆128Updated last year
• akx / ollama-dl
  Download models from the Ollama library, without Ollama
  ☆97Updated 10 months ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆118Updated last month
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆75Updated 10 months ago
• mzbac / wizardCoder-vsc
  Visual Studio Code extension for WizardCoder
  ☆149Updated 2 years ago
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆696Updated last week
• ptsochantaris / emeltal
  Local ML voice chat using high-end models.
  ☆175Updated 3 weeks ago
• microsoft / WizardLM2
  ☆59Updated last year
• UbiquitousLearning / PhoneLM
  ☆63Updated 10 months ago
• gpustack / gguf-parser-go
  Review/Check GGUF files and estimate the memory usage and maximum tokens per second.
  ☆205Updated 3 weeks ago
• tangledgroup / llama-cpp-wasm
  WebAssembly (Wasm) Build and Bindings for llama.cpp
  ☆280Updated last year
• dbpunk-labs / octogen
  Octogen is an Open-Source Code Interpreter Agent Framework
  ☆259Updated last year