Alternatives and similar repositories for llamafile:

Users that are interested in llamafile are comparing it to the libraries listed below

• unslothai / unsloth
  Finetune Llama 3.3, Mistral, Phi-4, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory
  ☆20,611Updated this week
• ggerganov / llama.cpp
  LLM inference in C/C++
  ☆70,826Updated this week
• BerriAI / litellm
  Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…
  ☆16,235Updated this week
• Mintplex-Labs / anything-llm
  The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.
  ☆30,389Updated this week
• TabbyML / tabby
  Self-hosted AI coding assistant
  ☆27,242Updated this week
• janhq / jan
  Jan is an open source alternative to ChatGPT that runs 100% offline on your computer
  ☆26,396Updated this week
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆33,809Updated this week
• ggerganov / ggml
  Tensor library for machine learning
  ☆11,541Updated this week
• mem0ai / mem0
  The Memory layer for your AI apps
  ☆23,953Updated this week
• letta-ai / letta
  Letta (formerly MemGPT) is a framework for creating LLM services with memory.
  ☆13,996Updated this week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆11,197Updated this week
• continuedev / continue
  ⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat…
  ☆21,432Updated this week
• Aider-AI / aider
  aider is AI pair programming in your terminal
  ☆24,970Updated this week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆28,480Updated this week
• mistralai / mistral-inference
  Official inference library for Mistral models
  ☆9,857Updated 2 months ago
• exo-explore / exo
  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
  ☆18,680Updated this week
• asg017 / sqlite-vec
  A vector search SQLite extension that runs anywhere!
  ☆4,670Updated last week
• ItzCrazyKns / Perplexica
  Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI
  ☆18,641Updated this week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,349Updated 4 months ago
• ShishirPatil / gorilla
  Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
  ☆11,688Updated this week
• ollama / ollama
  Get up and running with Llama 3.3, Phi 4, Gemma 2, and other large language models.
  ☆107,852Updated this week
• nilsherzig / LLocalSearch
  LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a ch…
  ☆5,783Updated 4 months ago
• SWE-agent / SWE-agent
  SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensiv…
  ☆14,188Updated this week
• ml-explore / mlx
  MLX: An array framework for Apple silicon
  ☆18,334Updated this week
• openai / tiktoken
  tiktoken is a fast BPE tokeniser for use with OpenAI's models.
  ☆13,023Updated 3 months ago
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆19,630Updated this week
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆38,057Updated this week
• OpenInterpreter / open-interpreter
  A natural language interface for computers
  ☆57,838Updated last month
• EricLBuehler / mistral.rs
  Blazingly fast LLM inference.
  ☆4,826Updated this week
• ggerganov / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆36,923Updated this week