Alternatives and similar repositories for llama.cpp-android-tutorial:

Users that are interested in llama.cpp-android-tutorial are comparing it to the libraries listed below

• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆184Updated 2 weeks ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• DataDropp / OllamaDroid
  A Ollama client for Android!
  ☆82Updated 9 months ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆303Updated last year
• Tempaccnt / Termux-alpaca
  This is a simple shell script to install the alpaca llama 7B model on termux for Android phones. All credits goes to the original develop…
  ☆60Updated last year
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 6 months ago
• latestissue / AltaeraAI
  A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
  ☆41Updated 8 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆154Updated this week
• Vali-98 / cui-llama.rn
  React Native binding of llama.cpp
  ☆26Updated this week
• kevkid / gguf_gui
  ☆102Updated 3 months ago
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 4 months ago
• jllllll / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆32Updated 11 months ago
• mlc-ai / binary-mlc-llm-libs
  ☆228Updated 3 months ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆146Updated last year
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆31Updated 7 months ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆49Updated last month
• rombodawg / Easy_training
  ☆45Updated this week
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆29Updated 2 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 7 months ago
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆112Updated this week
• yyjhao / wrait
  ☆44Updated last month
• YofarDev / yofardev_ai
  ☆40Updated 3 weeks ago
• ddh0 / easy-llama
  Text generation in Python, as easy as possible
  ☆53Updated this week
• niklasku / IF-webui
  DeepFloyd IF web UI
  ☆29Updated last year
• arthurwolf / llmi
  Large-Language-Model to Machine Interface project.
  ☆17Updated last year
• daniandtheweb / sd.cpp-webui
  A simple webui for stable-diffusion.cpp
  ☆24Updated this week
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆40Updated last week
• efogdev / apollo
  Deploy Apollo HF space locally
  ☆40Updated 2 months ago
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆93Updated 4 months ago
• chigkim / Ollama-MMLU-Pro
  ☆77Updated last month