Alternatives and similar repositories for llamafile

Users that are interested in llamafile are comparing it to the libraries listed below

• ggml-org / ggml
  Tensor library for machine learning
  ☆13,086Updated this week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆85,819Updated this week
• TabbyML / tabby
  Self-hosted AI coding assistant
  ☆32,020Updated last week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,040Updated this week
• ollama / ollama
  Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
  ☆151,103Updated this week
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆30,565Updated 5 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,531Updated 2 weeks ago
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆34,973Updated this week
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆42,741Updated last week
• continuedev / continue
  ⏩ Ship faster with Continuous AI. Build and run custom agents across your IDE, terminal, and CI
  ☆28,700Updated this week
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,050Updated 7 months ago
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,948Updated 4 months ago
• simonw / llm
  Access large language models from the command-line
  ☆9,548Updated 3 weeks ago
• dottxt-ai / outlines
  Structured Outputs
  ☆12,462Updated this week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,775Updated 11 months ago
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆21,192Updated last week
• Cinnamon / kotaemon
  An open-source RAG-based tool for chatting with your documents.
  ☆22,988Updated last month
• ollama / ollama-python
  Ollama Python library
  ☆8,356Updated last week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,729Updated last week
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆16,313Updated 3 months ago
• datalab-to / surya
  OCR, layout analysis, reading order, table recognition in 90+ languages
  ☆18,400Updated last week
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
  ☆23,850Updated last week
• jart / cosmopolitan
  build-once run-anywhere c library
  ☆19,693Updated 3 months ago
• letta-ai / letta
  Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.
  ☆18,108Updated this week
• leejet / stable-diffusion.cpp
  Stable Diffusion and Flux in pure C/C++
  ☆4,354Updated this week
• evilsocket / cake
  Distributed LLM and StableDiffusion inference for mobile, desktop and server.
  ☆2,881Updated 10 months ago
• Mintplex-Labs / anything-llm
  The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
  ☆48,456Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆28,040Updated this week
• datalab-to / marker
  Convert PDF to markdown + JSON quickly with high accuracy
  ☆28,307Updated this week
• vikhyat / moondream
  tiny vision language model
  ☆8,374Updated 2 weeks ago