Alternatives and similar repositories for deepspeedpatcher

Users that are interested in deepspeedpatcher are comparing it to the libraries listed below

• SystemPanic / vllm-windows
  A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
  ☆156Updated 2 weeks ago
• kanttouchthis / text_generation_webui_xtts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆155Updated last year
• NVIDIA / G-Assist
  Help shape the future of Project G-Assist
  ☆171Updated 3 months ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆63Updated last month
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆22Updated 5 months ago
• kalomaze / koboldcpp
  My personal fork of koboldcpp where I hack in experimental samplers.
  ☆47Updated last year
• S95Sedan / Deepspeed-Windows
  Deepspeed windows information
  ☆42Updated last year
• cp3249 / splaa
  SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…
  ☆28Updated 4 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆136Updated this week
• h43lb1t0 / KokoroTtsTexGernerationWebui
  An extension to use Kokoro TTS in text generation webui
  ☆21Updated 4 months ago
• Nyarlth / higgs-audio_quantized
  Quantized text-audio foundation model from Boson AI
  ☆33Updated last month
• Les-El / Ollm-Bridge
  Easily access your Ollama models within LMStudio
  ☆117Updated last year
• electroglyph / quant_clone
  Generate a llama-quantize command to copy the quantization parameters of any GGUF
  ☆24Updated last month
• kevkid / gguf_gui
  ☆121Updated 10 months ago
• rombodawg / Easy_training
  ☆50Updated 6 months ago
• flamingrickpat / private-machine
  private-machine is an AI companion system with emotion, needs and goals simulation based on LIDA cognitive architecture. Many agents for …
  ☆23Updated this week
• intelligencedev / eternal
  Eternal is an experimental platform for machine learning models and workflows.
  ☆68Updated 6 months ago
• chigkim / Ollama-MMLU-Pro
  ☆99Updated 3 weeks ago
• bartowski1182 / text-generation-webui-docker
  Docker images and configuration to run text-generation-webui with GPU or CPU support
  ☆30Updated last year
• sammcj / moa
  Mixture-of-Ollamas
  ☆30Updated last year
• Edw590 / VISOR---A-Voice-Assistant
  V.I.S.O.R., my in-development AI-powered voice assistant with integrated memory!
  ☆38Updated this week
• zeropointnine / tts-toy
  Chatbot-to-speech using Orpheus TTS model. Interactive console app.
  ☆19Updated 4 months ago
• parsakhaz / gaze-detection-video
  Use the Moondream 2 model to detect faces and their gaze directions in videos.
  ☆44Updated 8 months ago
• Zuellni / LLaSA-WebUI
  LLaSA WebUI using ExLlamaV2 and FastAPI.
  ☆28Updated 5 months ago
• Thireus / GGUF-Tool-Suite
  Input your VRAM and RAM and the toolchain will produce a GGUF model tuned to your system within seconds — flexible model sizing and lowes…
  ☆43Updated this week
• NeuralFalconYT / Kokoro-82M-WebUI
  ☆41Updated 7 months ago
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆90Updated this week
• DefamationStation / Retrochat-v2
  RetroChat is a powerful command-line interface for interacting with various AI language models. It provides a seamless experience for eng…
  ☆82Updated 2 months ago
• RobViren / kokovoicelab
  A cli app for experimenting with kokoro voice creating and mixing using the available voices to interpolate new ones
  ☆32Updated 7 months ago
• theroyallab / ST-tabbyAPI-loader
  Loader extension for tabbyAPI in SillyTavern
  ☆26Updated 2 months ago