Alternatives and similar repositories for deepspeedpatcher

Users that are interested in deepspeedpatcher are comparing it to the libraries listed below

• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆68Updated this week
• h43lb1t0 / KokoroTtsTexGernerationWebui
  An extension to use Kokoro TTS in text generation webui
  ☆22Updated 7 months ago
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆155Updated 2 years ago
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆28Updated 7 months ago
• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆41Updated this week
• SystemPanic / vllm-windows
  A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
  ☆253Updated 3 weeks ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆64Updated 4 months ago
• theroyallab / ST-tabbyAPI-loader
  Loader extension for tabbyAPI in SillyTavern
  ☆26Updated 5 months ago
• FaceDeer / storyteller
  A simple framework for using a local Koboldcpp LLM to help with story-writing
  ☆24Updated 2 years ago
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆68Updated 3 months ago
• mattjamo / OllamaToGGUF
  Convert downloaded Ollama models back into their GGUF equivalent format
  ☆66Updated 11 months ago
• oobabooga / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆36Updated 7 months ago
• Trojaner / text-generation-webui-stable_diffusion
  Integrate image generation capabilities to text-generation-webui using Stable Diffusion.
  ☆57Updated last year
• intelligencedev / eternal
  Eternal is an experimental platform for machine learning models and workflows.
  ☆68Updated 9 months ago
• rombodawg / Easy_training
  ☆51Updated 9 months ago
• kalomaze / koboldcpp
  My personal fork of koboldcpp where I hack in experimental samplers.
  ☆44Updated last year
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆154Updated last week
• cocktailpeanut / hallucinator
  ☆51Updated last year
• RobViren / kokovoicelab
  A cli app for experimenting with kokoro voice creating and mixing using the available voices to interpolate new ones
  ☆34Updated 10 months ago
• Teriks / dgenerate
  dgenerate is a scriptable command line tool (and library) for generating images and animation sequences using stable diffusion and relate…
  ☆40Updated 2 months ago
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆57Updated last year
• Lanerra / saga
  Autonomous, agentic, creative story writing system that incorporates stored embeddings and Knowledge Graphs.
  ☆82Updated this week
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆218Updated last month
• fszontagh / sd.cpp.gui.wx
  Stable Diffusion GUI written in C++
  ☆81Updated 2 months ago
• Zetaphor / solipnet
  An alternate reality web browser, powered by an LLM
  ☆17Updated last year
• NeuralFalconYT / Kokoro-82M-WebUI
  ☆44Updated 10 months ago
• yannikkellerde / AI-Snip
  Bring clippy back to windows
  ☆46Updated last year
• asaddi / f5-tts-serve
  A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…
  ☆15Updated 10 months ago
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆22Updated 8 months ago
• S95Sedan / Deepspeed-Windows
  Deepspeed windows information
  ☆44Updated last year