Alternatives and similar repositories for text-generation-webui:

Users that are interested in text-generation-webui are comparing it to the libraries listed below

• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆77,955Updated this week
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆20,355Updated this week
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,364Updated 2 weeks ago
• nomic-ai / gpt4all
  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
  ☆73,064Updated 3 weeks ago
• suno-ai / bark
  🔊 Text-Prompted Generative Audio Model
  ☆37,402Updated 7 months ago
• comfyanonymous / ComfyUI
  The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
  ☆73,563Updated this week
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,883Updated 8 months ago
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆40,761Updated this week
• lllyasviel / ControlNet
  Let us control diffusion models!
  ☆31,940Updated last year
• tatsu-lab / stanford_alpaca
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆29,914Updated 8 months ago
• cocktailpeanut / dalai
  The simplest way to run LLaMA on your local machine
  ☆13,083Updated 9 months ago
• LostRuins / koboldcpp
  Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
  ☆7,018Updated this week
• meta-llama / llama
  Inference code for Llama models
  ☆58,078Updated 2 months ago
• AUTOMATIC1111 / stable-diffusion-webui
  Stable Diffusion web UI
  ☆150,968Updated last month
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,235Updated last year
• ggml-org / whisper.cpp
  Port of OpenAI's Whisper model in C/C++
  ☆39,055Updated last week
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,365Updated 8 months ago
• mlc-ai / web-llm
  High-performance In-browser LLM Inference Engine
  ☆15,177Updated 2 months ago
• Vision-CAIR / MiniGPT-4
  Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
  ☆25,640Updated 7 months ago
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆44,418Updated this week
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆31,682Updated this week
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,828Updated last year
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,366Updated 10 months ago
• haotian-liu / LLaVA
  [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
  ☆22,171Updated 8 months ago
• gradio-app / gradio
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
  ☆37,334Updated this week
• ollama / ollama
  Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.
  ☆136,553Updated this week
• langchain-ai / langchain
  🦜🔗 Build context-aware reasoning applications
  ☆105,331Updated this week
• CompVis / stable-diffusion
  A latent text-to-image diffusion model
  ☆70,263Updated 9 months ago
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,558Updated 7 months ago
• mckaywrigley / chatbot-ui
  AI chat for any model.
  ☆30,816Updated 8 months ago