JackZeng0208 / llama.cpp-android-tutorial

Related projects: ⓘ

• mlc-ai / binary-mlc-llm-libs
  ☆194Updated this week
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆281Updated 7 months ago
• nerve-sparks / iris_android
  Local LLM App
  ☆114Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆119Updated this week
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated last month
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated 11 months ago
• RandomInternetPreson / Lucid_Autonomy
  An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3
  ☆33Updated last week
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers model
  ☆154Updated 4 months ago
• tcsenpai / multi1
  multi1: create o1-like reasoning chains with multiple AI providers (and locally)
  ☆64Updated this week
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆96Updated 4 months ago
• atomlayer / llama_cute_voice_assistant
  Llama cute voice assistant
  ☆28Updated last year
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆84Updated 2 months ago
• latestissue / AltaeraAI
  A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
  ☆38Updated 2 months ago
• DefamationStation / Retrochat
  A simple light terminal style chat app that lets you use connect to your local llama.cpp server
  ☆27Updated 2 months ago
• matatonic / openedai-vision
  An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.
  ☆157Updated this week
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated 10 months ago
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆39Updated 2 months ago
• statchamber / ebook-to-chatml-conversion
  idea: https://github.com/nyxkrage/ebook-groupchat/
  ☆77Updated last month
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo
  ☆159Updated this week
• beyondExp / B-Llama3-o
  B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.
  ☆25Updated 3 months ago
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆66Updated 11 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆46Updated 4 months ago
• DataDropp / OllamaDroid
  A Ollama client for Android!
  ☆78Updated 4 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆79Updated 3 weeks ago
• Ce-daros / Tinystory-LM-656K-param
  ☆14Updated 3 months ago
• Mobile-Artificial-Intelligence / maid_llm
  maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
  ☆42Updated 3 weeks ago
• BBuf / run-rwkv-world-4-in-mlc-llm
  ☆20Updated 10 months ago
• cpldcpu / MisguidedAttention
  A collection of prompts to challenge the reasoning abilities of large language models in presence of misguiding information
  ☆51Updated this week
• cognitivecomputations / OpenChatML
  ☆144Updated 2 months ago
• nyunAI / PruneGPT
  ☆50Updated 3 months ago