Alternatives and similar repositories for llama.cpp:

Users that are interested in llama.cpp are comparing it to the libraries listed below

• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆87Updated 7 months ago
• mzbac / mlx-moe
  Scripts to create your own moe models using mlx
  ☆89Updated last year
• fairydreaming / llama.cpp
  LLM inference in C/C++
  ☆19Updated this week
• teknium1 / ShareGPT-Builder
  ☆111Updated 3 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆80Updated 2 months ago
• chigkim / Ollama-MMLU-Pro
  ☆83Updated 3 months ago
• cognitivecomputations / OpenChatML
  ☆152Updated 8 months ago
• unslothai / unsloth-studio
  Unsloth Studio
  ☆73Updated 2 weeks ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated last month
• nyunAI / PruneGPT
  ☆53Updated 9 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆59Updated 7 months ago
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆163Updated this week
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 8 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆71Updated 3 weeks ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆138Updated last month
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆104Updated 10 months ago
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆174Updated 8 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated 11 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆84Updated 2 weeks ago
• cognitivecomputations / spectrum
  ☆112Updated 6 months ago
• keeeeenw / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆11Updated 11 months ago
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• Vaibhavs10 / 2024-ai-timeline
  ☆71Updated 2 months ago
• AstraBert / PrAIvateSearch
  Own your AI, search the web with it🌐😎
  ☆82Updated 2 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 2 months ago
• AlexBodner / How_Much_VRAM
  ☆99Updated 6 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆82Updated 4 months ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 4 months ago
• otriscon / llm-structured-output
  ☆79Updated 2 months ago