mudler / LocalAI
The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
☆31,079Updated this week
Alternatives and similar repositories for LocalAI:
Users that are interested in LocalAI are comparing it to the libraries listed below
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, and more.☆41,451Updated this week
- Jan is an open source alternative to ChatGPT that runs 100% offline on your computer☆28,094Updated this week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆72,884Updated this week
- A Gradio web UI for Large Language Models with support for multiple inference backends.☆42,906Updated this week
- Self-hosted AI coding assistant☆30,481Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆84,864Updated this week
- Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.☆133,757Updated this week
- Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products wi…☆37,569Updated last week
- ⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other…☆24,632Updated this week
- LLM inference in C/C++☆76,950Updated this week
- Finetune Llama 3.3, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥☆35,466Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆19,333Updated this week
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆38,132Updated 3 weeks ago
- The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.☆71,402Updated this week
- Universal LLM Deployment Engine with ML Compilation☆20,220Updated this week
- The Memory layer for AI Agents☆26,364Updated this week
- Port of OpenAI's Whisper model in C/C++☆38,606Updated this week
- 🔊 Text-Prompted Generative Audio Model☆37,245Updated 7 months ago
- Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.☆12,484Updated this week
- Distribute and run LLMs with a single file.☆22,019Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆31,990Updated this week
- aider is AI pair programming in your terminal☆29,525Updated this week
- Enhanced ChatGPT Clone: Features Agents, DeepSeek, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, …☆23,416Updated this week
- Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, m…☆84,096Updated this week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆28,655Updated this week
- the AI-native open-source embedding database☆18,797Updated this week
- LLM based autonomous agent that conducts deep local and web research on any topic and generates a long report with citations.☆20,377Updated this week
- High-performance In-browser LLM Inference Engine☆15,031Updated 2 months ago
- Instant voice cloning by MIT and MyShell. Audio foundation model.☆31,425Updated 2 months ago
- OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…☆37,251Updated 7 months ago