Alternatives and similar repositories for sherpa

Users that are interested in sherpa are comparing it to the libraries listed below

• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆225Updated 6 months ago
• BrutalCoding / shady.ai
  Making offline AI models accessible to all types of edge devices.
  ☆142Updated last year
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• mlc-ai / binary-mlc-llm-libs
  ☆249Updated last month
• Mobile-Artificial-Intelligence / llama_sdk
  lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)
  ☆96Updated this week
• BrutalCoding / aub.ai
  AubAI brings you on-device gen-AI capabilities, including offline text generation and more, directly within your app.
  ☆296Updated last year
• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆120Updated 3 months ago
• netdur / llama_cpp_dart
  dart binding for llama.cpp
  ☆245Updated last week
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• rupeshs / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM (Android/Linux/Windows/Mac)
  ☆265Updated 2 years ago
• Manuel030 / llama2.c-android
  Inference Llama 2 in one file of pure C
  ☆42Updated 2 years ago
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆456Updated last year
• Telosnex / fllama
  llama.cpp for Flutter
  ☆178Updated last week
• danemadsen / maid
  Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models.
  ☆77Updated 3 months ago
• alex-vt / WhisperInput
  Offline voice input panel & keyboard with punctuation for Android.
  ☆106Updated last year
• PotatoSpudowski / fastLLaMa
  fastLLaMa: An experimental high-performance framework for running Decoder-only LLMs with 4-bit quantization in Python using a C/C++ backe…
  ☆410Updated 2 years ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆128Updated 2 years ago
• AndrewVeee / nucleo-ai
  An AI assistant beyond the chat box.
  ☆328Updated last year
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆215Updated 10 months ago
• Maximilian-Winter / llama-cpp-agent
  The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …
  ☆579Updated 5 months ago
• lee-b / kobold_assistant
  Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 …
  ☆160Updated 11 months ago
• BrutalCoding / llama_dart
  Flutter / Dart bindings for llama.cpp
  ☆20Updated last year
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆260Updated 2 weeks ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆162Updated last year
• mbzuai-oryx / MobiLlama
  [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices
  ☆653Updated 2 months ago
• ParisNeo / lollms_legacy
  Lord of LLMS
  ☆295Updated 2 weeks ago
• skeskinen / bert.cpp
  ggml implementation of BERT
  ☆495Updated last year
• PABannier / bark.cpp
  Suno AI's Bark model in C/C++ for fast text-to-speech generation
  ☆834Updated 8 months ago
• AI-Commandos / LLaMa2lang
  Convenience scripts to finetune (chat-)LLaMa3 and other models for any language
  ☆310Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆185Updated last year