Alternatives and similar repositories for llama.cpp

Users that are interested in llama.cpp are comparing it to the libraries listed below

• ggml-org / ggml
  Tensor library for machine learning
  ☆12,697Updated last week
• oobabooga / text-generation-webui
  LLM UI with advanced features, easy setup, and multiple backend support.
  ☆44,023Updated this week
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,751Updated 3 weeks ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,257Updated last month
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆40,959Updated this week
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆50,358Updated this week
• nomic-ai / gpt4all
  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
  ☆73,654Updated 3 weeks ago
• meta-llama / llama
  Inference code for Llama models
  ☆58,399Updated 4 months ago
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,475Updated 10 months ago
• ollama / ollama
  Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.
  ☆144,510Updated this week
• openai / whisper
  Robust Speech Recognition via Large-Scale Weak Supervision
  ☆83,735Updated last month
• Mozilla-Ocho / llamafile
  Distribute and run LLMs with a single file.
  ☆22,633Updated last month
• tatsu-lab / stanford_alpaca
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆30,043Updated 11 months ago
• langchain-ai / langchain
  🦜🔗 Build context-aware reasoning applications
  ☆109,727Updated this week
• gradio-app / gradio
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
  ☆38,681Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,227Updated 2 years ago
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆20,813Updated 2 weeks ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,918Updated 10 months ago
• openai / tiktoken
  tiktoken is a fast BPE tokeniser for use with OpenAI's models.
  ☆14,886Updated 3 months ago
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆42,492Updated this week
• CompVis / stable-diffusion
  A latent text-to-image diffusion model
  ☆70,980Updated last year
• hpcaitech / ColossalAI
  Making large AI models cheaper, faster and more accessible
  ☆40,987Updated this week
• meta-llama / codellama
  Inference code for CodeLlama models
  ☆16,332Updated 10 months ago
• comfyanonymous / ComfyUI
  The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
  ☆80,233Updated this week
• open-webui / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆99,512Updated this week
• deepspeedai / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆38,997Updated this week
• unslothai / unsloth
  Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.
  ☆40,815Updated this week
• LAION-AI / Open-Assistant
  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…
  ☆37,384Updated 10 months ago
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆33,330Updated this week
• hiyouga / LLaMA-Factory
  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
  ☆52,785Updated this week