Alternatives and similar repositories for deepspeedpatcher

Users that are interested in deepspeedpatcher are comparing it to the libraries listed below

• SystemPanic / vllm-windows
  A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
  ☆42Updated last week
• Edw590 / VISOR---A-Voice-Assistant
  V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!
  ☆36Updated last month
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆21Updated 2 months ago
• theroyallab / ST-tabbyAPI-loader
  Loader extension for tabbyAPI in SillyTavern
  ☆25Updated 10 months ago
• h43lb1t0 / KokoroTtsTexGernerationWebui
  An extension to use Kokoro TTS in text generation webui
  ☆20Updated last month
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆154Updated last year
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆55Updated 4 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 6 months ago
• cocktailpeanut / deeperhermes
  deep hermes, but decides how to respond based on its OWN decision, no need for system prompts.
  ☆36Updated 2 months ago
• Krisseck / Phrasing-Bot
  A bot that checks your grammar and phrasing using LLM of choice
  ☆29Updated 4 months ago
• parsakhaz / gaze-detection-video
  Use the Moondream 2 model to detect faces and their gaze directions in videos.
  ☆40Updated 4 months ago
• hyperfocAIs / Attend
  Attend - to what matters.
  ☆15Updated 3 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆30Updated this week
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆54Updated 7 months ago
• RandomInternetPreson / LucidWebSearch
  A web search extension for Oobabooga's text-generation-webui (now with nougat)
  ☆74Updated 11 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.C…
  ☆107Updated this week
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆68Updated 11 months ago
• Saganaki22 / StableAudioWebUI
  A Lightweight Gradio Web interface for Text-to-Audio Generation utilising SAO1.0
  ☆53Updated 11 months ago
• rsxdalv / one-click-installers-tts
  Simplified installers for suno-ai/bark, musicgen, tortoise, RVC, demucs and vocos
  ☆46Updated 11 months ago
• altoiddealer / ad_discordbot
  Discord bot which transforms your servers into hubs for limitless local AI-driven interaction and content creation. Features cutting-edge…
  ☆38Updated this week
• Dartvauder / NeuroSandboxWebUI
  (Windows/Linux/MacOS) Local WebUI with neural network models (Text, Image, Video, 3D, Audio) on python (Gradio interface). Translated on …
  ☆96Updated 3 weeks ago
• rombodawg / Easy_training
  ☆48Updated 3 months ago
• Viceman256 / TensorTune
  KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning
  ☆22Updated 2 weeks ago
• ill13 / SpeakLocal
  A TTS extension for oobabooga text WebUI
  ☆32Updated last year
• mattjamo / OllamaToGGUF
  Convert downloaded Ollama models back into their GGUF equivalent format
  ☆33Updated 5 months ago
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆54Updated last year
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆57Updated last year
• remichu-ai / gallamaUI
  ☆23Updated 7 months ago
• extopico / llama-server_mcp_proxy
  Simple node proxy for llama-server that enables MCP use
  ☆13Updated 3 weeks ago
• FaceDeer / storyteller
  A simple framework for using a local Koboldcpp LLM to help with story-writing
  ☆21Updated last year