JackZeng0208 / llama.cpp-android-tutorial

Related projects ⓘ

Alternatives and complementary repositories for llama.cpp-android-tutorial

• mlc-ai / binary-mlc-llm-libs
  ☆208Updated 2 weeks ago
• nerve-sparks / iris_android
  Local LLM App
  ☆135Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆140Updated this week
• Tempaccnt / Termux-alpaca
  This is a simple shell script to install the alpaca llama 7B model on termux for Android phones. All credits goes to the original develop…
  ☆59Updated last year
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆294Updated 9 months ago
• latestissue / AltaeraAI
  A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
  ☆40Updated 5 months ago
• DefamationStation / Retrochat
  A simple light terminal style chat app that lets you use connect to your local llama.cpp server
  ☆27Updated 4 months ago
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• Mobile-Artificial-Intelligence / maid_llm
  maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
  ☆48Updated 2 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆48Updated 6 months ago
• chigkim / Ollama-MMLU-Pro
  ☆65Updated 2 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆110Updated 6 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆66Updated last year
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 3 months ago
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆226Updated last month
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…
  ☆96Updated last month
• DataDropp / OllamaDroid
  A Ollama client for Android!
  ☆79Updated 6 months ago
• Manuel030 / llama2.c-android
  Inference Llama 2 in one file of pure C
  ☆40Updated last year
• statchamber / ebook-to-chatml-conversion
  idea: https://github.com/nyxkrage/ebook-groupchat/
  ☆82Updated 3 months ago
• rombodawg / Easy_training
  ☆40Updated 2 months ago
• Vali-98 / cui-llama.rn
  React Native binding of llama.cpp
  ☆20Updated this week
• arthurwolf / llmi
  Large-Language-Model to Machine Interface project.
  ☆17Updated 11 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆93Updated this week
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆89Updated last month
• BBuf / run-rwkv-world-4-in-mlc-llm
  ☆21Updated last year
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆114Updated last year
• jllllll / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆31Updated 8 months ago
• frapastique / frapuse-ai-companion-android-app
  This repository represents my final assignment of "Module 3 - Android App Development" at Syntax Institut.
  ☆28Updated 10 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆100Updated 6 months ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆35Updated last year