Alternatives and similar repositories for llamafile

Users that are interested in llamafile are comparing it to the libraries listed below

• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆86,426Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,134Updated last week
• continuedev / continue
  ⏩ Ship faster with Continuous AI. Build and run custom agents across your IDE, terminal, and CI
  ☆28,927Updated this week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,950Updated 4 months ago
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,741Updated last year
• ollama / ollama
  Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
  ☆152,001Updated this week
• open-webui / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆109,730Updated this week
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
  ☆24,112Updated this week
• TabbyML / tabby
  Self-hosted AI coding assistant
  ☆32,088Updated 3 weeks ago
• Aider-AI / aider
  aider is AI pair programming in your terminal
  ☆37,352Updated last week
• oobabooga / text-generation-webui
  The definitive Web UI for local AI, with powerful features and easy setup.
  ☆44,962Updated last week
• letta-ai / letta
  Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.
  ☆18,356Updated this week
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,735Updated last year
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆28,592Updated last week
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆28,156Updated this week
• nomic-ai / gpt4all
  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
  ☆76,672Updated 3 months ago
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆58,035Updated this week
• Mintplex-Labs / anything-llm
  The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.
  ☆48,907Updated this week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆21,302Updated this week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆35,272Updated this week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,566Updated last month
• danielmiessler / Fabric
  Fabric is an open-source framework for augmenting humans using AI. It provides a modular system for solving specific problems using a cro…
  ☆33,386Updated last week
• menloresearch / jan
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
  ☆37,725Updated last week
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆43,071Updated last week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,074Updated last week
• simonw / llm
  Access large language models from the command-line
  ☆9,666Updated last month
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,116Updated 7 months ago
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆16,427Updated 4 months ago
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,329Updated last month
• unslothai / unsloth
  Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less…
  ☆45,445Updated this week