Alternatives and similar repositories for vllm-windows

Users that are interested in vllm-windows are comparing it to the libraries listed below

• phildougherty / qwen2.5_omni_chat
  Service for testing out the new Qwen2.5 omni model
  ☆62Updated 8 months ago
• sgsdxzy / YuE-exllamav2
  ☆135Updated 10 months ago
• kevkid / gguf_gui
  ☆128Updated last year
• S95Sedan / Deepspeed-Windows
  Deepspeed windows information
  ☆44Updated last year
• NeuralFalconYT / Kokoro-82M-WebUI
  ☆46Updated 11 months ago
• Nyarlth / higgs-audio_quantized
  Quantized text-audio foundation model from Boson AI
  ☆43Updated 5 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆220Updated 3 weeks ago
• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆44Updated last week
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆112Updated last month
• leomaxwell973 / Triton-3.3.0-UPDATE_FROM_3.2.0_and_FIXED-Windows-Nvidia-Prebuilt
  This is a pre-built wheel of Triton 3.3.0 for Windows with Nvidia only + Proton
  ☆40Updated 8 months ago
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆147Updated last month
• fahdmirza / comfyuiworkflows
  Free ComfyUI Workflows
  ☆43Updated 3 weeks ago
• calcuis / gguf-connector
  gguf (GPT-Generated Unified Format) connector
  ☆49Updated last week
• rombodawg / Easy_training
  ☆51Updated 11 months ago
• deepbeepmeep / mmgp
  Memory Management for the GPU Poor, run the latest open source frontier models on consumer Nvidia GPUs
  ☆170Updated this week
• Nexesenex / croco.cpp
  Croco.Cpp is fork of KoboldCPP infering GGML/GGUF models on CPU/Cuda with KoboldAI's UI. It's powered partly by IK_LLama.cpp, and compati…
  ☆153Updated this week
• AnyaCoder / fish-speech-gui
  PyQt6 1st try
  ☆293Updated last year
• daswer123 / deepspeed-windows-wheels
  A collection of compiled wheels for deepspeed built for python 3.10 and 3.11 with support for cuda 11.8 and 12.1 for Windows
  ☆86Updated last year
• wildminder / ComfyUI-VoxCPM
  ComfyUI node for highly expressive speech and realistic zero-shot voice cloning
  ☆371Updated last month
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆94Updated last month
• PurinNyova / Image-Detection-Bypass-Utility
  Attempts to bypass AI Image detection by employing various methods such as: Noise Injection, FFT Smoothing, FFT Matching, Pixel Perturbat…
  ☆191Updated 4 months ago
• PasiKoodaa / ACE-Step-RADIO
  ACE-Step: A Step Towards Music Generation Foundation Model
  ☆47Updated 8 months ago
• Saganaki22 / OrpheusTTS-WebUI
  Lightweight Gradio based WebUI for orpheusTTS - WSL / Linux [CUDA]
  ☆105Updated 2 months ago
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆68Updated 9 months ago
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆57Updated last year
• alisson-anjos / YuE-exllamav2-UI
  ☆44Updated 11 months ago
• oobabooga / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆36Updated 8 months ago
• aneeshjoy / vllm-windows
  Docker compose to run vLLM on Windows
  ☆113Updated 2 years ago
• komikndr / raylight
  Enable true multi gpu capability in Comfy UI using XDiT XFuser and FSDP managed by Ray
  ☆262Updated this week
• JamePeng / llama-cpp-python
  Python bindings for llama.cpp
  ☆144Updated this week