Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.
☆47,265Jun 2, 2026Updated this week
Alternatives and similar repositories for textgen
Users that are interested in textgen are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆114,217Updated this week
- Stable Diffusion web UI☆163,404Mar 2, 2026Updated 3 months ago
- An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.☆39,479May 1, 2026Updated last month
- GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.☆77,354May 27, 2025Updated last year
- The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.☆115,665Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆172,578May 28, 2026Updated last week
- LlamaIndex is the leading document agent and OCR platform☆49,909Updated this week
- The agent engineering platform.☆138,156Updated this week
- OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…☆37,410Aug 17, 2024Updated last year
- Run GGUF models easily with a KoboldAI UI. One File. Zero Install.☆10,688Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆139,661Updated this week
- AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus o…☆184,750Updated this week
- Interact with your documents using the power of GPT, 100% privately, no data leaks☆57,218Feb 26, 2026Updated 3 months ago
- 🔊 Text-Prompted Generative Audio Model☆39,145Aug 19, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath☆9,482Jun 7, 2025Updated 11 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆81,909Updated this week
- Inference code for Llama models☆59,438Jan 26, 2025Updated last year
- LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.☆46,662Updated this week
- Instruct-tune LLaMA on consumer hardware☆18,922Jul 29, 2024Updated last year
- Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and creat…☆27,337Updated this week
- Code and documentation to train Stanford's Alpaca models, and generate the data.☆30,248Jul 17, 2024Updated last year
- Universal LLM Deployment Engine with ML Compilation☆22,730May 11, 2026Updated 3 weeks ago
- Python bindings for llama.cpp☆10,364Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A programming framework for agentic AI☆58,533Apr 15, 2026Updated last month
- A natural language interface for computers☆63,803Updated this week
- LLM Frontend for Power Users.☆28,787May 20, 2026Updated 2 weeks ago
- 🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production☆45,462Aug 16, 2024Updated last year
- Build AI Agents, Visually☆53,245May 30, 2026Updated last week
- Robust Speech Recognition via Large-Scale Weak Supervision☆100,922Apr 15, 2026Updated last month
- Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.☆65,620Updated this week
- The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.☆60,870May 30, 2026Updated last week
- ☆22,283Jan 31, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…☆49,384Updated this week
- Port of OpenAI's Whisper model in C/C++☆50,475Updated this week
- Large Language Model Text Generation Inference☆10,857Mar 21, 2026Updated 2 months ago
- Making large AI models cheaper, faster and more accessible☆41,385May 25, 2026Updated last week
- Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!☆42,815Updated this week
- The simplest way to run LLaMA on your local machine☆12,930Jun 18, 2024Updated last year
- StableLM: Stability AI Language Models☆15,700Apr 8, 2024Updated 2 years ago