Alternatives and similar repositories for llamafile

Users that are interested in llamafile are comparing it to the libraries listed below

• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆88,512Updated this week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,171Updated this week
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,332Updated 9 months ago
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,891Updated last year
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,332Updated last week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,953Updated 6 months ago
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆36,008Updated last week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆21,527Updated last week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,678Updated 2 months ago
• nomic-ai / gpt4all
  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
  ☆76,829Updated 5 months ago
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
  ☆26,934Updated last week
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆16,712Updated this week
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆44,056Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,883Updated this week
• continuedev / continue
  ⏩ Ship faster with Continuous AI. Build and run custom agents across your IDE, terminal, and CI
  ☆29,476Updated this week
• menloresearch / jan
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
  ☆38,350Updated last week
• oobabooga / text-generation-webui
  The definitive Web UI for local AI, with powerful features and easy setup.
  ☆45,225Updated last week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,826Updated last year
• chroma-core / chroma
  Open-source search and retrieval database for AI applications.
  ☆24,161Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,201Updated 2 years ago
• ollama / ollama
  Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
  ☆154,818Updated this week
• ml-explore / mlx-examples
  Examples in the MLX framework
  ☆7,949Updated 3 weeks ago
• ml-explore / mlx
  MLX: An array framework for Apple silicon
  ☆22,587Updated last week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆12,861Updated last week
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,760Updated 3 months ago
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆30,339Updated this week
• dottxt-ai / outlines
  Structured Outputs
  ☆12,739Updated 2 weeks ago
• ollama / ollama-python
  Ollama Python library
  ☆8,752Updated 3 weeks ago
• unslothai / unsloth
  Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.
  ☆47,355Updated last week
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,521Updated 7 months ago