Alternatives and similar repositories for vllm-windows

Users that are interested in vllm-windows are comparing it to the libraries listed below

• phildougherty / qwen2.5_omni_chat
  Service for testing out the new Qwen2.5 omni model
  ☆61Updated 6 months ago
• S95Sedan / Deepspeed-Windows
  Deepspeed windows information
  ☆42Updated last year
• Nyarlth / higgs-audio_quantized
  Quantized text-audio foundation model from Boson AI
  ☆41Updated 3 months ago
• NeuralFalconYT / Kokoro-82M-WebUI
  ☆42Updated 9 months ago
• kevkid / gguf_gui
  ☆124Updated last year
• leomaxwell973 / Triton-3.3.0-UPDATE_FROM_3.2.0_and_FIXED-Windows-Nvidia-Prebuilt
  This is a pre-built wheel of Triton 3.3.0 for Windows with Nvidia only + Proton
  ☆39Updated 6 months ago
• daswer123 / deepspeed-windows-wheels
  A collection of compiled wheels for deepspeed built for python 3.10 and 3.11 with support for cuda 11.8 and 12.1 for Windows
  ☆77Updated last year
• sgsdxzy / YuE-exllamav2
  ☆128Updated 8 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆214Updated 3 weeks ago
• oobabooga / flash-attention
  Fast and memory-efficient exact attention - Windows wheels
  ☆36Updated 6 months ago
• Thireus / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆35Updated this week
• envy-ai / Wan2.1-quantized
  Wan2.1, quantized and optimized so it fits on your 3090/4090
  ☆34Updated 8 months ago
• alisson-anjos / YuE-exllamav2-UI
  ☆43Updated 9 months ago
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆92Updated 7 months ago
• Electrofried / ComfyUI-OpenAINode
  This is a simple node for comfyUI that accesses any openAI API server the user specifies and enables simple text generation with a string…
  ☆27Updated last year
• fahdmirza / comfyuiworkflows
  Free ComfyUI Workflows
  ☆38Updated 2 months ago
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆117Updated last month
• SeanScripts / ComfyUI-PixtralLlamaMolmoVision
  For loading and running Pixtral models
  ☆77Updated 9 months ago
• Dartvauder / NeuroSandboxWebUI
  (Windows/Linux/MacOS) Local WebUI with neural network models (Text, Image, Video, 3D, Audio) on python (Gradio interface). Translated on …
  ☆107Updated last week
• deepbeepmeep / OminiControlGP
  OminiControl for the GPU Poor
  ☆39Updated 9 months ago
• cocktailpeanut / hallucinator
  ☆50Updated last year
• calcuis / gguf-connector
  gguf (GPT-Generated Unified Format) connector
  ☆44Updated this week
• wkpark / triton
  Development repository for the Triton language and compiler
  ☆33Updated last year
• wildminder / ComfyUI-VibeVoice
  ComfyUI custom node for the VibeVoice TTS. Expressive, long-form, multi-speaker conversational audio
  ☆511Updated last month
• asaddi / f5-tts-serve
  A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…
  ☆15Updated 9 months ago
• jllllll / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆25Updated 2 years ago
• deepbeepmeep / mmgp
  Memory Management for the GPU Poor, run the latest open source frontier models on consumer Nvidia GPUs
  ☆155Updated 3 weeks ago
• NSFW-API / TripleX
  ☆223Updated 6 months ago
• fredconex / ComfyUI-SongBloom
  ComfyUI Nodes for SongBloom
  ☆189Updated 2 months ago
• deepbeepmeep / Cosmos1GP
  Cosmos1GP for the GPU Poor by DeepBeepMeep
  ☆81Updated 9 months ago