Alternatives and similar repositories for llamafile

Users that are interested in llamafile are comparing it to the libraries listed below

• ggml-org / ggml
  Tensor library for machine learning
  ☆13,230Updated last week
• continuedev / continue
  ⏩ Ship faster with Continuous AI. Build and run custom agents across your IDE, terminal, and CI
  ☆29,160Updated this week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆87,149Updated this week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,635Updated last month
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆35,621Updated this week
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆43,649Updated this week
• ollama / ollama
  Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.
  ☆153,598Updated this week
• menloresearch / jan
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
  ☆38,088Updated this week
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆6,132Updated this week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,950Updated 5 months ago
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,824Updated this week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,803Updated last year
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆12,817Updated this week
• zylon-ai / private-gpt
  Interact with your documents using the power of GPT, 100% privately, no data leaks
  ☆56,624Updated 10 months ago
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆6,210Updated 8 months ago
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆21,440Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆29,564Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,539Updated 3 weeks ago
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
  ☆26,270Updated this week
• neuml / txtai
  💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
  ☆11,662Updated 2 weeks ago
• ml-explore / mlx
  MLX: An array framework for Apple silicon
  ☆22,395Updated this week
• menloresearch / cortex.cpp
  Local AI API Platform
  ☆2,763Updated 3 months ago
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆28,825Updated this week
• SJTU-IPADS / PowerInfer
  High-speed Large Language Model Serving for Local Deployment
  ☆8,347Updated 2 months ago
• open-webui / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆111,447Updated this week
• chroma-core / chroma
  Open-source search and retrieval database for AI applications.
  ☆23,665Updated this week
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆16,571Updated 3 weeks ago
• plandex-ai / plandex
  Open source AI coding agent. Designed for large projects and real world tasks.
  ☆14,510Updated this week
• cocktailpeanut / dalai
  The simplest way to run LLaMA on your local machine
  ☆13,049Updated last year
• apple / corenet
  CoreNet: A library for training deep neural networks
  ☆7,017Updated last month