Alternatives and similar repositories for binary-mlc-llm-libs:

Users that are interested in binary-mlc-llm-libs are comparing it to the libraries listed below

• JackZeng0208 / llama.cpp-android-tutorial
  llama.cpp tutorial on Android phone
  ☆98Updated 2 weeks ago
• Bip-Rep / sherpa
  A mobile Implementation of llama.cpp
  ☆308Updated last year
• nerve-sparks / iris_android
  IRIS is an android app for interfacing with GGUF / llama.cpp models locally.
  ☆192Updated 2 months ago
• DataDropp / OllamaDroid
  A Ollama client for Android!
  ☆83Updated 11 months ago
• Picovoice / picollm
  On-device LLM Inference Powered by X-Bit Quantization
  ☆234Updated 2 weeks ago
• ZTMIDGO / Android-Stable-diffusion-ONNX
  使用Android手机的CPU推理stable diffusion
  ☆151Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆168Updated this week
• mbzuai-oryx / MobiLlama
  MobiLlama : Small Language Model tailored for edge devices
  ☆632Updated last year
• latestissue / AltaeraAI
  A set of bash scripts to automate deployment of GGML/GGUF models [default: RWKV] with the use of KoboldCpp on Android - Termux
  ☆41Updated 10 months ago
• nuance1979 / llama-server
  LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
  ☆122Updated last year
• ggerganov / bark.cpp
  Port of Suno AI's Bark in C/C++ for fast inference
  ☆52Updated last year
• shubham0204 / SmolChat-Android
  Running any GGUF SLMs/LLMs locally, on-device in Android
  ☆263Updated this week
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆629Updated last month
• RWKV / rwkv.cpp
  INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
  ☆1,509Updated last month
• foldl / chatllm.cpp
  Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)
  ☆573Updated this week
• ZTMIDGO / RWKV-Android
  使用Android cpu 运行 RWKV V4 ONNX
  ☆70Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated 11 months ago
• zkh2016 / LLMFarm
  MiniCPM on iOS.
  ☆68Updated last month
• dsd / sherpa
  A mobile Implementation of llama.cpp
  ☆25Updated last year
• bigcode-project / starcoder.cpp
  C++ implementation for 💫StarCoder
  ☆453Updated last year
• harrisonvanderbyl / rwkv-cpp-accelerated
  A torchless, c++ rwkv implementation using 8bit quantization, written in cuda/hip/vulkan for maximum compatibility and minimum dependenci…
  ☆310Updated last year
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆292Updated this week
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆55Updated 2 months ago
• NexaAI / octopus-v4
  AI for all: Build the large graph of the language models
  ☆263Updated 10 months ago
• futo-org / whisper-acft
  ☆122Updated 9 months ago
• cryscan / web-rwkv
  Implementation of the RWKV language model in pure WebGPU/Rust.
  ☆298Updated last week
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆263Updated 6 months ago
• TroyTzou / mlc-llm-android
  参考自mlc-llm，个人尝试在android手机上部署大模型并运行
  ☆86Updated 8 months ago
• mlc-ai / relax
  ☆156Updated 3 weeks ago
• shixiangcap / llama-jni
  Android JNI for port of Facebook's LLaMA model in C/C++
  ☆22Updated last year