Alternatives and similar repositories for text-generation-webui

Users that are interested in text-generation-webui are comparing it to the libraries listed below

• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆39,402Updated 8 months ago
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆94,823Updated this week
• ollama / ollama
  Get up and running with Kimi-K2.5, GLM-4.7, DeepSeek, gpt-oss, Qwen, Gemma and other models.
  ☆162,082Updated this week
• meta-llama / llama
  Inference code for Llama models
  ☆59,141Updated last year
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆46,841Updated last week
• LostRuins / koboldcpp
  Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
  ☆9,462Updated this week
• AUTOMATIC1111 / stable-diffusion-webui
  Stable Diffusion web UI
  ☆160,514Updated last month
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,971Updated 5 months ago
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,477Updated 8 months ago
• open-webui / open-webui
  User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  ☆123,582Updated this week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement, running on consumer-g…
  ☆42,616Updated last week
• nomic-ai / gpt4all
  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
  ☆77,136Updated 8 months ago
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,978Updated last year
• haotian-liu / LLaVA
  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
  ☆24,446Updated last year
• Comfy-Org / ComfyUI
  The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
  ☆102,600Updated this week
• unslothai / unsloth
  Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.
  ☆51,922Updated this week
• langchain-ai / langchain
  🦜🔗 The platform for reliable agents.
  ☆126,317Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆12,099Updated 2 weeks ago
• huggingface / chat-ui
  The open source codebase powering HuggingChat
  ☆10,501Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,757Updated last month
• chroma-core / chroma
  Open-source search and retrieval database for AI applications.
  ☆26,064Updated this week
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆17,258Updated this week
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,186Updated 2 years ago
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆22,012Updated this week
• gradio-app / gradio
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
  ☆41,593Updated last week
• ParisNeo / lollms-webui
  Lord of Large Language and Multi modal Systems Web User Interface
  ☆4,772Updated this week
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,835Updated last year
• BerriAI / litellm
  Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing a…
  ☆35,429Updated this week
• vladmandic / sdnext
  SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing
  ☆6,937Updated this week
• ymcui / Chinese-LLaMA-Alpaca
  中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
  ☆18,962Updated 6 months ago