Alternatives and similar repositories for llama.cpp-android-tutorial:

Users that are interested in llama.cpp-android-tutorial are comparing it to the libraries listed below

• mlc-ai / binary-mlc-llm-libs
  ☆216Updated 2 months ago
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆161Updated 2 weeks ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆299Updated 11 months ago
• Tempaccnt / Termux-alpaca
  This is a simple shell script to install the alpaca llama 7B model on termux for Android phones. All credits goes to the original develop…
  ☆59Updated last year
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆151Updated this week
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 5 months ago
• Vali-98 / cui-llama.rn
  React Native binding of llama.cpp
  ☆24Updated this week
• DataDropp / OllamaDroid
  A Ollama client for Android!
  ☆81Updated 8 months ago
• aneeshjoy / vllm-windows
  Docker compose to run vLLM on Windows
  ☆53Updated last year
• latestissue / AltaeraAI
  A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
  ☆41Updated 7 months ago
• Manuel030 / llama2.c-android
  Inference Llama 2 in one file of pure C
  ☆42Updated last year
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆146Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆177Updated 8 months ago
• janhq / cortex.tensorrt-llm
  Cortex.Tensorrt-LLM is a C++ inference library that can be loaded by any server at runtime. It submodules NVIDIA’s TensorRT-LLM for GPU a…
  ☆42Updated 3 months ago
• BBuf / run-rwkv-world-4-in-mlc-llm
  ☆21Updated last year
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…
  ☆103Updated 2 months ago
• recursal / ai-town-rwkv-proxy
  Run a large AI town, locally, via RWKV !
  ☆151Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆166Updated 8 months ago
• YofarDev / yofardev_ai
  ☆39Updated 2 weeks ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆64Updated 3 months ago
• beratcmn / local-intelligence
  Something similar to Apple Intelligence?
  ☆59Updated 6 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆116Updated last year
• cognitivecomputations / OpenChatML
  ☆151Updated 6 months ago
• ThomasBaruzier / gddr6-core-junction-vram-temps
  Core, Junction, and VRAM temperature reader for Linux + GDDR6/GDDR6X GPUs
  ☆27Updated last month
• niklasku / IF-webui
  DeepFloyd IF web UI
  ☆29Updated last year
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆139Updated 8 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆49Updated 8 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆39Updated last week
• Ce-daros / Tinystory-LM-656K-param
  ☆16Updated 7 months ago