Alternatives and similar repositories for vllm-windows

Users that are interested in vllm-windows are comparing it to the libraries listed below

• NeuralFalconYT / Kokoro-82M-WebUI
  ☆48Updated last week
• phildougherty / qwen2.5_omni_chat
  Service for testing out the new Qwen2.5 omni model
  ☆63Updated 9 months ago
• S95Sedan / Deepspeed-Windows
  Deepspeed windows information
  ☆44Updated last year
• kevkid / gguf_gui
  ☆128Updated last year
• sgsdxzy / YuE-exllamav2
  ☆135Updated 10 months ago
• daswer123 / deepspeed-windows-wheels
  A collection of compiled wheels for deepspeed built for python 3.10 and 3.11 with support for cuda 11.8 and 12.1 for Windows
  ☆86Updated last year
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆97Updated this week
• Saganaki22 / OrpheusTTS-WebUI
  Lightweight Gradio based WebUI for orpheusTTS - WSL / Linux [CUDA]
  ☆105Updated 2 months ago
• deepbeepmeep / mmgp
  Memory Management for the GPU Poor, run the latest open source frontier models on consumer Nvidia GPUs
  ☆171Updated 2 weeks ago
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆114Updated last month
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated last month
• calcuis / gguf-connector
  gguf (GPT-Generated Unified Format) connector
  ☆50Updated 3 weeks ago
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆154Updated last week
• NSFW-API / TripleX
  ☆229Updated 9 months ago
• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆49Updated last week
• Nyarlth / higgs-audio_quantized
  Quantized text-audio foundation model from Boson AI
  ☆43Updated 5 months ago
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆150Updated last month
• gpustack / llama-box
  LM inference server implementation based on *.cpp.
  ☆295Updated 2 months ago
• AnyaCoder / fish-speech-gui
  PyQt6 1st try
  ☆294Updated last year
• vibevoice-community / VibeVoice-API
  API server for VibeVoice
  ☆26Updated 4 months ago
• JamePeng / llama-cpp-python
  Python bindings for llama.cpp
  ☆174Updated last week
• rombodawg / Easy_training
  ☆51Updated 11 months ago
• fahdmirza / comfyuiworkflows
  Free ComfyUI Workflows
  ☆46Updated last week
• diodiogod / TTS-Audio-Suite
  A ComfyUI custom node integration for multi-engine multi-language Text-to-Speech and Voice Conversion. Supports: RVC, Qwen3-TTS, Cozy Voi…
  ☆616Updated this week
• alisson-anjos / YuE-exllamav2-UI
  ☆44Updated 11 months ago
• akashjss / orpheus-tts-local-webui
  Run Orpheus 3B Locally with Gradio UI, Standalone App
  ☆23Updated 10 months ago
• aneeshjoy / vllm-windows
  Docker compose to run vLLM on Windows
  ☆114Updated 2 years ago
• leomaxwell973 / Triton-3.3.0-UPDATE_FROM_3.2.0_and_FIXED-Windows-Nvidia-Prebuilt
  This is a pre-built wheel of Triton 3.3.0 for Windows with Nvidia only + Proton
  ☆40Updated 8 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆166Updated 9 months ago
• cocktailpeanut / hallucinator
  ☆51Updated last year