Alternatives and similar repositories for llamafile

Users that are interested in llamafile are comparing it to the libraries listed below

• ollama / ollama
  Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
  ☆158,406Updated last week
• continuedev / continue
  ⏩ Ship faster with Continuous AI. Open-source CLI that can be used in TUI mode as a coding agent or Headless mode to run background agent…
  ☆30,543Updated this week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆40,785Updated this week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,964Updated 2 weeks ago
• letta-ai / letta
  Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.
  ☆20,400Updated last week
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,764Updated 2 weeks ago
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,584Updated 11 months ago
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆19,063Updated last year
• open-webui / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆118,987Updated this week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,864Updated last year
• ml-explore / mlx
  MLX: An array framework for Apple silicon
  ☆23,275Updated last week
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,503Updated 4 months ago
• TabbyML / tabby
  Self-hosted AI coding assistant
  ☆32,635Updated this week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆92,005Updated this week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆13,052Updated last week
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆38,251Updated this week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,310Updated last week
• reorproject / reor
  Private & local AI personal knowledge management app for high entropy people.
  ☆8,440Updated 7 months ago
• abi / secret-llama
  Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
  ☆2,674Updated last year
• Aider-AI / aider
  aider is AI pair programming in your terminal
  ☆39,329Updated last week
• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆8,085Updated 2 weeks ago
• SWE-agent / SWE-agent
  SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersec…
  ☆18,109Updated last week
• oobabooga / text-generation-webui
  The definitive Web UI for local AI, with powerful features and easy setup.
  ☆45,706Updated last week
• ollama / ollama-python
  Ollama Python library
  ☆9,069Updated 3 weeks ago
• Mintplex-Labs / anything-llm
  The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
  ☆52,729Updated last week
• huggingface / chat-ui
  Open source codebase powering the HuggingChat app
  ☆10,397Updated last week
• twinnydotdev / twinny
  The most no-nonsense, locally or API-hosted AI code completion plugin for Visual Studio Code - like GitHub Copilot but 100% free.
  ☆3,621Updated 4 months ago
• meta-llama / codellama
  Inference code for CodeLlama models
  ☆16,372Updated last year
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆17,027Updated last month
• getumbrel / llama-gpt
  A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support…
  ☆10,990Updated last year