Alternatives and similar repositories for llama.cpp-android-tutorial

Users that are interested in llama.cpp-android-tutorial are comparing it to the libraries listed below

• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆312Updated last year
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆216Updated 4 months ago
• mlc-ai / binary-mlc-llm-libs
  ☆247Updated last month
• Manuel030 / llama2.c-android
  Inference Llama 2 in one file of pure C
  ☆42Updated last year
• Tempaccnt / Termux-alpaca
  This is a simple shell script to install the alpaca llama 7B model on termux for Android phones. All credits goes to the original develop…
  ☆62Updated last year
• UbiquitousLearning / PhoneLM
  ☆57Updated 7 months ago
• DataDropp / OllamaDroid
  A Ollama client for Android!
  ☆86Updated last year
• latestissue / AltaeraAI
  A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
  ☆42Updated last year
• tc-mb / llama.cpp
  Port of Facebook's LLaMA model in C/C++
  ☆96Updated 2 weeks ago
• stevelaskaridis / awesome-mobile-llm
  Awesome Mobile LLMs
  ☆204Updated 3 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆184Updated last week
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• HimariO / llama.cpp.qwen2.5vl
  Port of Facebook's LLaMA model in C/C++
  ☆52Updated last month
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆63Updated 9 months ago
• Vali-98 / cui-llama.rn
  React Native binding of llama.cpp
  ☆30Updated 3 weeks ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆112Updated 3 months ago
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆53Updated 3 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆54Updated 10 months ago
• BBuf / run-rwkv-world-4-in-mlc-llm
  ☆21Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆51Updated last year
• quic / ai-hub-apps
  The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…
  ☆216Updated 2 weeks ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆152Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• Yang-013 / Stable-diffusion-Android-termux
  Run SD onnx model on termux
  ☆21Updated 2 years ago
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆144Updated 2 weeks ago
• Lizonghang / TPI-LLM
  TPI-LLM: Serving 70b-scale LLMs Efficiently on Low-resource Edge Devices
  ☆180Updated 3 weeks ago
• EduardTalianu / EntropixLab
  entropix style sampling + GUI
  ☆26Updated 7 months ago
• keeeeenw / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆11Updated last year
• latent-variable / r1_reasoning_effort
  Forces DeepSeek R1 models to engage in extended reasoning by intercepting early termination tokens.
  ☆19Updated 4 months ago
• kevkid / gguf_gui
  ☆114Updated 7 months ago