Alternatives and similar repositories for llamafile

Users that are interested in llamafile are comparing it to the libraries listed below

• ggml-org / ggml
  Tensor library for machine learning
  ☆13,681Updated 2 weeks ago
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆90,838Updated last week
• ollama / ollama
  Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
  ☆157,308Updated this week
• TabbyML / tabby
  Self-hosted AI coding assistant
  ☆32,540Updated 2 weeks ago
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆16,924Updated 2 weeks ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,800Updated 3 months ago
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆44,967Updated this week
• ml-explore / mlx
  MLX: An array framework for Apple silicon
  ☆22,983Updated this week
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered answering engine. It is an Open source alternative to Perplexity AI
  ☆27,559Updated this week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,262Updated this week
• letta-ai / letta
  Letta is the platform for building stateful agents: open AI with advanced memory that can learn and self-improve over time.
  ☆19,465Updated last week
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,513Updated 10 months ago
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆32,679Updated last month
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆64,758Updated this week
• chroma-core / chroma
  Open-source search and retrieval database for AI applications.
  ☆24,734Updated this week
• continuedev / continue
  ⏩ Ship faster with Continuous AI. Open-source CLI that can be used in TUI mode as a coding agent or Headless mode to run background agent…
  ☆30,177Updated this week
• open-webui / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆117,009Updated last week
• zylon-ai / private-gpt
  Interact with your documents using the power of GPT, 100% privately, no data leaks
  ☆56,880Updated last year
• BerriAI / litellm
  Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…
  ☆32,131Updated this week
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆39,290Updated 6 months ago
• janhq / jan
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
  ☆39,620Updated this week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆39,865Updated this week
• oobabooga / text-generation-webui
  The definitive Web UI for local AI, with powerful features and easy setup.
  ☆45,550Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,987Updated this week
• unslothai / unsloth
  Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.
  ☆49,033Updated this week
• mem0ai / mem0
  Universal memory layer for AI Agents
  ☆43,920Updated last week
• dottxt-ai / outlines
  Structured Outputs
  ☆13,025Updated last week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆13,000Updated this week
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆10,581Updated 2 weeks ago
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,434Updated 4 months ago