Alternatives and similar repositories for llama.cpp

Users that are interested in llama.cpp are comparing it to the libraries listed below

• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆100Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated last month
• uukuguy / speechless
  LLM based agents with proactive interactions, long-term memory, external tool integration, and local deployment capabilities.
  ☆107Updated 6 months ago
• unslothai / unsloth-studio
  Unsloth Studio
  ☆126Updated 10 months ago
• QuixiAI / kraken
  ☆68Updated last year
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆97Updated 9 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆65Updated last year
• adriancable / qwen3.c
  Local Qwen3 LLM inference. One easy-to-understand file of C source with no dependencies.
  ☆157Updated 7 months ago
• kyutai-labs / moshivis
  Kyutai with an "eye"
  ☆235Updated 10 months ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆49Updated 3 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆92Updated last year
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆242Updated last year
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆100Updated 7 months ago
• AlexBodner / How_Much_VRAM
  ☆101Updated last year
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆57Updated last year
• ArturTanona / grpo_unsloth_docker
  ☆57Updated 11 months ago
• QuixiAI / spectrum
  ☆141Updated 5 months ago
• huggingface / local-gemma
  Gemma 2 optimized for your local machine.
  ☆378Updated last year
• and270 / thinking_effort_processor
  ☆94Updated 7 months ago
• QuixiAI / OpenChatML
  ☆166Updated 6 months ago
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆110Updated 8 months ago
• janhq / ReZero
  ☆159Updated 9 months ago
• Doriandarko / MLX-GRPO
  A pure MLX-based training pipeline for fine-tuning LLMs using GRPO on Apple Silicon.
  ☆226Updated 3 months ago
• lechmazur / pgg_bench
  Public Goods Game (PGG) Benchmark: Contribute & Punish is a multi-agent benchmark that tests cooperative and self-interested strategies a…
  ☆39Updated 9 months ago
• unslothai / unsloth-zoo
  Utils for Unsloth https://github.com/unslothai/unsloth
  ☆188Updated last week
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆245Updated last year
• sgl-project / sgl-project.github.io
  This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang
  ☆100Updated last week
• remichu-ai / gallama
  ☆135Updated last month