mudler / LocalAI
The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
☆31,682Updated this week
Alternatives and similar repositories for LocalAI:
Users that are interested in LocalAI are comparing it to the libraries listed below
- Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.☆136,553Updated this week
- Self-hosted AI coding assistant☆30,782Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆88,841Updated this week
- Distribute and run LLMs with a single file.☆22,157Updated this week
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…☆25,488Updated this week
- Universal LLM Deployment Engine with ML Compilation☆20,355Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆44,418Updated this week
- A Gradio web UI for Large Language Models with support for multiple inference backends.☆43,157Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆42,577Updated this week
- LLM inference in C/C++☆77,955Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆20,671Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆73,064Updated 3 weeks ago
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆40,881Updated this week
- Finetune Llama 4, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥☆36,949Updated this week
- Jan is an open source alternative to ChatGPT that runs 100% offline on your computer☆28,438Updated this week
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆11,098Updated this week
- Drag & drop UI to build your customized LLM flow☆37,088Updated this week
- Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.☆15,854Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆29,969Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆38,364Updated 2 weeks ago
- 🦜🔗 Build context-aware reasoning applications☆105,331Updated this week
- High-performance In-browser LLM Inference Engine☆15,177Updated 2 months ago
- the AI-native open-source embedding database☆19,226Updated this week
- Port of OpenAI's Whisper model in C/C++☆39,198Updated this week
- Inference code for Llama models☆58,078Updated 2 months ago
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆34,783Updated this week
- Enhanced ChatGPT Clone: Features Agents, DeepSeek, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, …☆24,279Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆21,269Updated this week
- 🔊 Text-Prompted Generative Audio Model☆37,431Updated 7 months ago
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆39,440Updated this week