Alternatives and similar repositories for binary-mlc-llm-libs

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆101Updated last week
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆311Updated last year
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆203Updated 3 months ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆152Updated last year
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆630Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆175Updated this week
• Cornell-RelaxML / quip-sharp
  ☆532Updated 6 months ago
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• DataDropp / OllamaDroid
  A Ollama client for Android!
  ☆84Updated last year
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆123Updated last year
• MegEngine / InferLLM
  a lightweight LLM model inference framework
  ☆728Updated last year
• latestissue / AltaeraAI
  A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
  ☆41Updated 10 months ago
• cognitivecomputations / OpenChatML
  ☆156Updated 10 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆152Updated 11 months ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆237Updated last week
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆147Updated last year
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 8 months ago
• mbzuai-oryx / MobiLlama
  MobiLlama : Small Language Model tailored for edge devices
  ☆636Updated this week
• Lisoveliy / StarCoderEx
  Extension for using alternative GitHub Copilot (StarCoder API) in VSCode
  ☆100Updated last year
• oobabooga / GPTQ-for-LLaMa
  4 bits quantization of LLaMa using GPTQ
  ☆130Updated last year
• alex-vt / WhisperInput
  Offline voice input panel & keyboard with punctuation for Android.
  ☆103Updated 11 months ago
• mlc-ai / relax
  ☆156Updated last month
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,514Updated last month
• Vahe1994 / SpQR
  ☆543Updated 4 months ago
• BrutalCoding / shady.ai
  Making offline AI models accessible to all types of edge devices.
  ☆138Updated last year
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆208Updated 9 months ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆488Updated last year
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆136Updated this week
• dzhulgakov / llama-mistral
  Inference code for Mistral and Mixtral hacked up into original Llama implementation
  ☆371Updated last year