Alternatives and similar repositories for text-generation-webui

Users that are interested in text-generation-webui are comparing it to the libraries listed below

• unit-mesh / edge-infer
  EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained de…
  ☆49Updated last year
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆40Updated last year
• BeautyyuYanli / GPT-SoVITS-Infer
  The inference code of RVC-Boss/GPT-SoVITS that can be developer-friendly.
  ☆15Updated last year
• soulteary / dify-with-classical-search
  Enable AI to quickly retrieve content, simply!
  ☆53Updated last year
• blackcon / VicunaWithGUI
  This project support a WEB UI with Vicuna13B (using llama-cpp-python, chatbot-ui)
  ☆46Updated 2 years ago
• soulteary / amazing-openai-api
  Convert different model APIs into the OpenAI API format out of the box.
  ☆160Updated last year
• open-edge-platform / edge-developer-kit-reference-scripts
  Developer kits reference setup scripts for various kinds of Intel platforms and GPUs
  ☆38Updated last week
• SchneeHertz / chat-xiuliu
  LLM Client with Function Calling | LLM客户端，支持联网，IO操作和执行代码
  ☆68Updated 5 months ago
• MaletteAI / anytext
  ☆33Updated last year
• bupticybee / FastLoRAChat
  Instruct-tune LLaMA on consumer hardware with shareGPT data
  ☆126Updated 2 years ago
• leogogog / chatgpt-doc-translator
  This is a web service built using FastAPI and OpenAI's GPT-3.5-Turbo model that enables translation of various types of documents. The se…
  ☆135Updated 2 years ago
• vra / talkGPT4All
  A voice chatbot based on GPT4All and talkGPT, running on your local pc!
  ☆152Updated last year
• stanford-oval / ovalchat
  OVALChat is a customizable Web app aimed at conducting user studies with chatbots
  ☆28Updated last year
• fengmm521 / KimiChat-API-Simple
  封装KimiAI的API，快速调用AI回复
  ☆11Updated last year
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆62Updated last week
• wangyifan2018 / ChatDoc-TPU
  适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆14Updated last year
• soulteary / docker-chatgpt
  < 10MB, One-click self-hosted ChatGPT, allowing access to various data sources and non-OpenAI models.
  ☆141Updated 2 years ago
• EmbraceAGI / LocalAGI
  LocalAGI：Locally run AGI powered by LLaMA, ChatGLM and more. ｜ 基于 ChatGLM, LLaMA 大模型的本地运行的 AGI
  ☆81Updated 2 years ago
• siliconflow / siliconcloud-cookbook
  SiliconCloud Cookbook
  ☆22Updated 8 months ago
• unslothai / llama.cpp
  LLM inference in C/C++
  ☆103Updated last week
• RobinQu / instinct.cpp
  instinct.cpp provides ready to use alternatives to OpenAI Assistant API and built-in utilities for developing AI Agent applications (RAG,…
  ☆53Updated last year
• soulteary / docker-sdxl
  简单、靠谱的 SDXL Docker 使用方案。
  ☆41Updated last year
• soulteary / docker-code-interpreter
  One-click Docker APPs of Open-source Code Interpreter Projects.
  ☆61Updated 2 years ago
• WisdomShell / llama_cpp_for_codeshell
  CodeShell model in C/C++
  ☆105Updated last year
• nomic-ai / llama.cpp
  llama.cpp fork used by GPT4All
  ☆57Updated 8 months ago
• soulteary / sparrow
  ChatGPT Style client-compatible Backend Server, open source implementation.
  ☆95Updated last year
• marty1885 / llama.cpp
  My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend
  ☆107Updated last week
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆68Updated 6 months ago
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆289Updated 2 months ago
• josStorer / llama.cpp-unicode-windows
  llama.cpp with unicode (windows) support
  ☆54Updated 2 years ago