mudler / LocalAI
The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
☆32,314Updated this week
Alternatives and similar repositories for LocalAI:
Users that are interested in LocalAI are comparing it to the libraries listed below
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆92,548Updated this week
- Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.☆139,442Updated this week
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…☆26,010Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆43,502Updated this week
- Self-hosted AI coding assistant☆31,021Updated this week
- A Gradio web UI for Large Language Models with support for multiple inference backends.☆43,430Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆21,842Updated this week
- A natural language interface for computers☆59,272Updated last week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆38,502Updated 3 weeks ago
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆73,238Updated last month
- 🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSe…☆60,012Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆41,371Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,216Updated last week
- aider is AI pair programming in your terminal☆32,400Updated this week
- Universal LLM Deployment Engine with ML Compilation☆20,548Updated this week
- Jan is an open source alternative to ChatGPT that runs 100% offline on your computer☆28,764Updated this week
- LLM inference in C/C++☆79,077Updated this week
- Distribute and run LLMs with a single file.☆22,317Updated 2 weeks ago
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆16,248Updated this week
- Drag & drop UI to build your customized LLM flow☆37,797Updated this week
- Open source codebase powering the HuggingChat app☆8,645Updated this week
- MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone☆19,346Updated 2 months ago
- Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥☆37,861Updated this week
- High-performance In-browser LLM Inference Engine☆15,365Updated this week
- 🔊 Text-Prompted Generative Audio Model☆37,629Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆46,456Updated this week
- OpenUI let's you describe UI using your imagination, then see it rendered live.☆21,061Updated 2 weeks ago
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆30,866Updated this week
- Enhanced ChatGPT Clone: Features Agents, DeepSeek, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, …☆25,188Updated this week
- 🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming☆55,182Updated last month