Alternatives and similar repositories for llamafile

Users that are interested in llamafile are comparing it to the libraries listed below

• ollama / ollama
  Get up and running with Kimi-K2.5, GLM-4.7, DeepSeek, gpt-oss, Qwen, Gemma and other models.
  ☆162,082Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…
  ☆35,429Updated this week
• b4rtaz / distributed-llama
  Distributed LLM inference. Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.
  ☆2,822Updated last week
• continuedev / continue
  ⏩ Ship faster with Continuous AI. Open-source CLI that can be used in Headless mode to run async cloud agents or TUI mode as an in sync c…
  ☆31,266Updated this week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆94,823Updated this week
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆46,518Updated this week
• janhq / jan
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
  ☆40,345Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,923Updated this week
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered answering engine.
  ☆28,711Updated last month
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,930Updated last year
• janhq / cortex.cpp
  Local AI API Platform
  ☆2,762Updated 7 months ago
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆69,622Updated this week
• nomic-ai / gpt4all
  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
  ☆77,078Updated 8 months ago
• open-webui / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆123,582Updated this week
• EricLBuehler / mistral.rs
  Fast, flexible LLM inference
  ☆6,508Updated this week
• Aider-AI / aider
  aider is AI pair programming in your terminal
  ☆40,449Updated 3 weeks ago
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆46,841Updated this week
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,891Updated last year
• TabbyML / tabby
  Self-hosted AI coding assistant
  ☆32,849Updated this week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,967Updated 2 months ago
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆39,392Updated 8 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,958Updated 5 months ago
• datalab-to / marker
  Convert PDF to markdown + JSON quickly with high accuracy
  ☆31,582Updated this week
• exo-explore / exo
  Run frontier AI locally.
  ☆41,347Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,757Updated last month
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆22,012Updated this week
• guidance-ai / guidance
  A guidance language for controlling large language models.
  ☆21,270Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆12,099Updated 2 weeks ago
• huggingface / chat-ui
  The open source codebase powering HuggingChat
  ☆10,501Updated this week
• Vaibhavs10 / insanely-fast-whisper
  ☆8,809Updated 3 months ago