Alternatives and similar repositories for text-generation-webui

Users that are interested in text-generation-webui are comparing it to the libraries listed below

• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,850Updated last month
• AUTOMATIC1111 / stable-diffusion-webui
  Stable Diffusion web UI
  ☆154,435Updated 2 months ago
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆42,937Updated this week
• nlpxucan / WizardLM
  LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
  ☆9,428Updated last month
• mlc-ai / mlc-llm
  Universal LLM Deployment Engine with ML Compilation
  ☆20,950Updated this week
• nomic-ai / gpt4all
  GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
  ☆73,802Updated last month
• invoke-ai / InvokeAI
  Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and creat…
  ☆25,507Updated this week
• bentoml / OpenLLM
  Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
  ☆11,540Updated last week
• ggml-org / llama.cpp
  LLM inference in C/C++
  ☆82,936Updated this week
• Stability-AI / StableLM
  StableLM: Stability AI Language Models
  ☆15,826Updated last year
• cocktailpeanut / dalai
  The simplest way to run LLaMA on your local machine
  ☆13,074Updated last year
• tloen / alpaca-lora
  Instruct-tune LLaMA on consumer hardware
  ☆18,921Updated 11 months ago
• Stability-AI / stablediffusion
  High-Resolution Image Synthesis with Latent Diffusion Models
  ☆41,353Updated 2 weeks ago
• LostRuins / koboldcpp
  Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
  ☆7,773Updated this week
• huggingface / text-generation-inference
  Large Language Model Text Generation Inference
  ☆10,311Updated last week
• meta-llama / llama
  Inference code for Llama models
  ☆58,509Updated 5 months ago
• mudler / LocalAI
  The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on…
  ☆33,842Updated this week
• langchain-ai / langchain
  🦜🔗 Build context-aware reasoning applications
  ☆111,268Updated this week
• bigscience-workshop / petals
  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
  ☆9,710Updated 10 months ago
• artidoro / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆10,550Updated last year
• tatsu-lab / stanford_alpaca
  Code and documentation to train Stanford's Alpaca models, and generate the data.
  ☆30,065Updated 11 months ago
• microsoft / autogen
  A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…
  ☆47,085Updated this week
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆52,204Updated this week
• microsoft / JARVIS
  JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
  ☆24,223Updated 9 months ago
• antimatter15 / alpaca.cpp
  Locally run an Instruction-Tuned Chat-Style LLM
  ☆10,226Updated 2 years ago
• SillyTavern / SillyTavern
  LLM Frontend for Power Users.
  ☆16,043Updated this week
• gradio-app / gradio
  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
  ☆38,949Updated this week
• letta-ai / letta
  Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.
  ☆17,263Updated this week
• chroma-core / chroma
  the AI-native open-source embedding database
  ☆21,009Updated this week
• LAION-AI / Open-Assistant
  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamical…
  ☆37,408Updated 10 months ago