mudler / LocalAI
The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference
☆28,480Updated this week
Alternatives and similar repositories for LocalAI:
Users that are interested in LocalAI are comparing it to the libraries listed below
- Drag & drop UI to build your customized LLM flow☆33,978Updated this week
- Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sag…☆16,235Updated this week
- Get up and running with Llama 3.3, Phi 4, Gemma 2, and other large language models.☆107,852Updated this week
- Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products wi…☆37,112Updated last week
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆71,730Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆56,881Updated this week
- LlamaIndex is the leading framework for building LLM-powered agents over your data.☆38,057Updated this week
- Universal LLM Deployment Engine with ML Compilation☆19,630Updated this week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, and more.☆30,389Updated this week
- ⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat…☆21,432Updated this week
- Interact with your documents using the power of GPT, 100% privately, no data leaks☆54,897Updated 2 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆37,496Updated this week
- A Gradio web UI for Large Language Models with support for multiple inference backends.☆41,616Updated this week
- Jan is an open source alternative to ChatGPT that runs 100% offline on your computer☆26,396Updated this week
- LLM inference in C/C++☆70,826Updated this week
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆37,558Updated this week
- Enhanced ChatGPT Clone: Features Agents, Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI,…☆20,530Updated this week
- aider is AI pair programming in your terminal☆24,970Updated this week
- Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, m…☆58,979Updated this week
- the AI-native open-source embedding database☆17,023Updated this week
- The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.☆63,655Updated this week
- Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.☆11,420Updated this week
- Perplexica is an AI-powered search engine. It is an Open source alternative to Perplexity AI☆18,641Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆22,748Updated this week
- Automate browser-based workflows with LLMs and Computer Vision☆11,426Updated this week
- 🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.☆21,693Updated this week
- 🦜🔗 Build context-aware reasoning applications☆98,422Updated this week
- 🙌 OpenHands: Code Less, Make More☆43,403Updated this week
- Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.☆10,380Updated this week
- Distribute and run LLMs with a single file.☆21,262Updated last week