Alternatives and similar repositories for vllm-windows

Users that are interested in vllm-windows are comparing it to the libraries listed below

• phildougherty / qwen2.5_omni_chat
  Service for testing out the new Qwen2.5 omni model
  ☆62Updated 7 months ago
• Nyarlth / higgs-audio_quantized
  Quantized text-audio foundation model from Boson AI
  ☆41Updated 3 months ago
• kevkid / gguf_gui
  ☆126Updated last year
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated last month
• NeuralFalconYT / Kokoro-82M-WebUI
  ☆43Updated 10 months ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆153Updated this week
• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆40Updated this week
• sgsdxzy / YuE-exllamav2
  ☆133Updated 9 months ago
• S95Sedan / Deepspeed-Windows
  Deepspeed windows information
  ☆44Updated last year
• daswer123 / deepspeed-windows-wheels
  A collection of compiled wheels for deepspeed built for python 3.10 and 3.11 with support for cuda 11.8 and 12.1 for Windows
  ☆81Updated last year
• asaddi / f5-tts-serve
  A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…
  ☆15Updated 10 months ago
• Saganaki22 / OrpheusTTS-WebUI
  Lightweight Gradio based WebUI for orpheusTTS - WSL / Linux [CUDA]
  ☆105Updated 3 weeks ago
• cocktailpeanut / hallucinator
  ☆51Updated last year
• wkpark / triton
  Development repository for the Triton language and compiler
  ☆34Updated last year
• oobabooga / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆36Updated 7 months ago
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆125Updated last month
• PasiKoodaa / ACE-Step-RADIO
  ACE-Step: A Step Towards Music Generation Foundation Model
  ☆45Updated 6 months ago
• leomaxwell973 / Triton-3.3.0-UPDATE_FROM_3.2.0_and_FIXED-Windows-Nvidia-Prebuilt
  This is a pre-built wheel of Triton 3.3.0 for Windows with Nvidia only + Proton
  ☆39Updated 6 months ago
• FartyPants / StoryCrafter
  Writing Extension for Text Generation WebUI
  ☆64Updated 4 months ago
• fahdmirza / comfyuiworkflows
  Free ComfyUI Workflows
  ☆40Updated 2 weeks ago
• deepbeepmeep / mmgp
  Memory Management for the GPU Poor, run the latest open source frontier models on consumer Nvidia GPUs
  ☆160Updated 2 weeks ago
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆57Updated last year
• envy-ai / Wan2.1-quantized
  Wan2.1, quantized and optimized so it fits on your 3090/4090
  ☆34Updated 9 months ago
• AnyaCoder / fish-speech-gui
  PyQt6 1st try
  ☆291Updated 11 months ago
• alisson-anjos / YuE-exllamav2-UI
  ☆44Updated 10 months ago
• NSFW-API / TripleX
  ☆227Updated 7 months ago
• wildminder / ComfyUI-VoxCPM
  ComfyUI node for highly expressive speech and realistic zero-shot voice cloning
  ☆320Updated last month
• deepbeepmeep / OminiControlGP
  OminiControl for the GPU Poor
  ☆39Updated 10 months ago
• gpustack / vox-box
  A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.
  ☆178Updated last week
• Dartvauder / NeuroSandboxWebUI
  (Windows/Linux/MacOS) Local WebUI with neural network models (Text, Image, Video, 3D, Audio) on python (Gradio interface). Translated on …
  ☆107Updated 2 weeks ago