Alternatives and similar repositories for text-generation-webui

Users that are interested in text-generation-webui are comparing it to the libraries listed below

• unit-mesh / edge-infer
  EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained de…
  ☆50Updated last year
• BeautyyuYanli / GPT-SoVITS-Infer
  The inference code of RVC-Boss/GPT-SoVITS that can be developer-friendly.
  ☆16Updated last year
• sophgo / ChatGLM3-TPU
  run chatglm3-6b in BM1684X
  ☆39Updated last year
• EmbraceAGI / LocalAGI
  LocalAGI：Locally run AGI powered by LLaMA, ChatGLM and more. ｜ 基于 ChatGLM, LLaMA 大模型的本地运行的 AGI
  ☆81Updated 2 years ago
• soulteary / dify-with-classical-search
  Enable AI to quickly retrieve content, simply!
  ☆54Updated last year
• soulteary / docker-code-interpreter
  One-click Docker APPs of Open-source Code Interpreter Projects.
  ☆62Updated 2 years ago
• TaskingAI / TaskingAI-Python-Client
  TaskingAI Python Client
  ☆21Updated last year
• linexjlin / realtime_transcription
  ASR using OpenAI capability API `v1/audio/transcriptions` like Groq, SiliconFlow
  ☆31Updated last year
• inuwamobarak / nougat
  Nougat is a Meta AI's revolutionary OCR model designed to transcribe scientific PDFs into an easy-to-use Markdown format.
  ☆27Updated 2 years ago
• AaronFeng753 / Better-Qwen3
  Auto Thinking Mode switch for Qwen3 in Open webui
  ☆70Updated 8 months ago
• OpenCSGs / llm-inference
  llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deploy…
  ☆91Updated last year
• Nico-JIN / deepseek-ocr-website
  ☆35Updated 3 months ago
• lewangdev / CosyVoice
  Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.
  ☆13Updated last year
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆71Updated 2 weeks ago
• WisdomShell / llama_cpp_for_codeshell
  CodeShell model in C/C++
  ☆106Updated last year
• llmapi-io / llmapi-server
  Self-host llmapi server, make it really easy for accessing LLMs !
  ☆37Updated 2 years ago
• blackcon / VicunaWithGUI
  This project support a WEB UI with Vicuna13B (using llama-cpp-python, chatbot-ui)
  ☆45Updated 2 years ago
• sugarforever / peanut-shell
  ☆53Updated last year
• gxr404 / go-deepwiki
  油猴脚本添加github跳转deepwiki按钮
  ☆47Updated 3 weeks ago
• zkh2016 / LLMFarm
  MiniCPM on iOS.
  ☆67Updated 10 months ago
• MaletteAI / anytext
  ☆33Updated last year
• bupticybee / FastLoRAChat
  Instruct-tune LLaMA on consumer hardware with shareGPT data
  ☆125Updated 2 years ago
• soulteary / docker-sdxl
  简单、靠谱的 SDXL Docker 使用方案。
  ☆41Updated 2 years ago
• soulteary / amazing-openai-api
  Convert different model APIs into the OpenAI API format out of the box.
  ☆160Updated last year
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated 2 years ago
• stanford-oval / ovalchat
  OVALChat is a customizable Web app aimed at conducting user studies with chatbots
  ☆29Updated 2 years ago
• wangyifan2018 / ChatDoc-TPU
  适用于sophon bm1684x，基于 Langchain 与 ChatGLM 等语言模型的本地知识库问答
  ☆14Updated last year
• akx / ggify
  Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp
  ☆169Updated 9 months ago
• OpenBuddy / GrandSage
  ☆16Updated last year
• liangdabiao / simple_ai_toolset
  AI大模型的基本开发框架，适合普通后端程序员，功能类似coze包括：fastapi后端接口，搜索，文档解析和向量化，RPA和爬虫，自定义agent，对接第三方数据接口，mongodb数据库，控制json返回，多模态理解和生成等等
  ☆13Updated last year