Alternatives and similar repositories for llamafile

Users that are interested in llamafile are comparing it to the libraries listed below

• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆84,641Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,969Updated last week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,426Updated 3 weeks ago
• ollama / ollama
  Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
  ☆149,645Updated this week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆34,402Updated this week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆5,996Updated this week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,752Updated 11 months ago
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,415Updated 4 months ago
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,694Updated last year
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,221Updated 2 years ago
• vikhyat / moondream
  tiny vision language model
  ☆8,275Updated last week
• TabbyML / tabby
  Self-hosted AI coding assistant
  ☆31,916Updated this week
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,626Updated last year
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
  ☆23,385Updated last week
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆26,994Updated last week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,948Updated 3 months ago
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆5,969Updated 6 months ago
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆21,099Updated this week
• meta-llama / llama
  Inference code for Llama models
  ☆58,621Updated 6 months ago
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆42,113Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,669Updated last week
• continuedev / continue
  ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of rules, tools, and models
  ☆28,210Updated this week
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,301Updated last week
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆10,147Updated this week
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆29,873Updated 4 months ago
• Aider-AI / aider
  aider is AI pair programming in your terminal
  ☆36,527Updated this week
• menloresearch / jan
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
  ☆35,439Updated this week
• cocktailpeanut / dalai
  The simplest way to run LLaMA on your local machine
  ☆13,068Updated last year
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆27,105Updated this week
• menloresearch / cortex.cpp
  Local AI API Platform
  ☆2,766Updated last month