Alternatives and similar repositories for llamafile:

Users that are interested in llamafile are comparing it to the libraries listed below

• ggerganov / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆38,321Updated this week
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆26,223Updated this week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆76,180Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆18,548Updated this week
• ollama / ollama
  Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.
  ☆131,836Updated this week
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
  ☆20,441Updated this week
• open-webui / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆82,156Updated this week
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆18,468Updated this week
• continuedev / continue
  ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…
  ☆24,283Updated this week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆11,756Updated last week
• vikhyat / moondream
  tiny vision language model
  ☆7,547Updated 2 weeks ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,492Updated 6 months ago
• Mintplex-Labs / anything-llm
  The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.
  ☆40,558Updated this week
• dottxt-ai / outlines
  Structured Text Generation
  ☆10,958Updated this week
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,048Updated last week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆10,918Updated last week
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆8,784Updated this week
• ggml-org / ggml
  Tensor library for machine learning
  ☆12,051Updated this week
• stanfordnlp / dspy
  DSPy: The framework for programming—not prompting—language models
  ☆22,362Updated this week
• TabbyML / tabby
  Self-hosted AI coding assistant
  ☆30,348Updated this week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,862Updated 6 months ago
• oobabooga / text-generation-webui
  A Gradio web UI for Large Language Models with support for multiple inference backends.
  ☆42,790Updated last week
• assafelovic / gpt-researcher
  LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.
  ☆19,904Updated this week
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆39,727Updated this week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆30,895Updated this week
• janhq / jan
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
  ☆27,947Updated this week
• letta-ai / letta
  Letta (formerly MemGPT) is a framework for creating LLM services with memory.
  ☆15,168Updated this week
• unslothai / unsloth
  Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! 🦥
  ☆34,064Updated this week
• VikParuchuri / marker
  Convert PDF to markdown + JSON quickly with high accuracy
  ☆22,514Updated this week
• instructor-ai / instructor
  structured outputs for llms
  ☆9,706Updated this week