Alternatives and similar repositories for llama.cpp

Users that are interested in llama.cpp are comparing it to the libraries listed below

• HimariO / llama.cpp.qwen2.5vl
  Port of Facebook's LLaMA model in C/C++
  ☆67Updated 9 months ago
• zai-org / GLM-Edge
  GLM Series Edge Models
  ☆158Updated 7 months ago
• 1694439208 / GOT-OCR-Inference
  研究GOT-OCR-项目落地加速，不限语言
  ☆62Updated last year
• infinigence / Infini-Megrez-Omni
  ☆242Updated 11 months ago
• OpenSQZ / MiniCPM-V-CookBook
  Cook up amazing multimodal AI applications effortlessly with MiniCPM-o
  ☆290Updated this week
• DakeQQ / Native-LLM-for-Android
  Demonstration of running a native LLM on Android device.
  ☆226Updated this week
• DataXujing / Qwen1.5-0.5b-chat-android
  基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat
  ☆89Updated last year
• infinigence / Infini-Megrez
  ☆341Updated 3 months ago
• AXERA-TECH / ax-llm
  Explore LLM model deployment based on AXera's AI chips
  ☆139Updated this week
• Oneflow-Inc / diffusers
  ☆31Updated last year
• tc-mb / ollama
  Get up and running with Llama 3, Mistral, Gemma, and other large language models.
  ☆32Updated last week
• Achazwl / mlc
  MiniCPM on Android platform.
  ☆636Updated 10 months ago
• wangzhaode / mnn-stable-diffusion
  stable diffusion using mnn
  ☆67Updated 2 years ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆49Updated last year
• Tlntin / qwen-ascend-llm
  ☆55Updated last year
• sophgo / LLM-TPU
  Run generative AI models in sophgo BM1684X/BM1688
  ☆266Updated 2 weeks ago
• wangzhaode / llm-export
  llm-export can export llm model to onnx.
  ☆343Updated 3 months ago
• OpenBMB / MiniCPM-CookBook
  This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…
  ☆299Updated 7 months ago
• OpenBMB / MobileCPM
  A Toolkit for Running On-device Large Language Models (LLMs) in APP
  ☆81Updated last year
• viitrix / vt-transformer
  Transformer framework for edge computing based on C++.
  ☆130Updated last year
• QwenLM / qwen.cpp
  C++ implementation of Qwen-LM
  ☆616Updated last year
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆90Updated this week
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆73Updated this week
• XiaoMi / StableDiffusionOnDevice
  本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。
  ☆231Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆49Updated last year
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆39Updated last year
• daquexian / faster-rwkv
  ☆125Updated 2 years ago
• MollySophia / rwkv-mobile
  Inference RWKV with multiple supported backends.
  ☆77Updated this week
• FunAudioLLM / FunAudioLLM-APP
  ☆379Updated last year