Alternatives and similar repositories for vllm-windows

Users that are interested in vllm-windows are comparing it to the libraries listed below

• NeuralFalconYT / Kokoro-82M-WebUI
  ☆40Updated 6 months ago
• phildougherty / qwen2.5_omni_chat
  Service for testing out the new Qwen2.5 omni model
  ☆55Updated 3 months ago
• cocktailpeanut / hallucinator
  ☆51Updated 9 months ago
• deepbeepmeep / OminiControlGP
  OminiControl for the GPU Poor
  ☆38Updated 6 months ago
• kevkid / gguf_gui
  ☆120Updated 9 months ago
• sgsdxzy / YuE-exllamav2
  ☆120Updated 5 months ago
• wkpark / triton
  Development repository for the Triton language and compiler
  ☆34Updated 10 months ago
• rsxdalv / chatterbox
  SoTA open-source TTS
  ☆50Updated 3 weeks ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆195Updated last week
• PasiKoodaa / ACE-Step-RADIO
  ACE-Step: A Step Towards Music Generation Foundation Model
  ☆42Updated 3 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 8 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆33Updated last week
• Nyarlth / higgs-audio_quantized
  Quantized text-audio foundation model from Boson AI
  ☆22Updated last week
• envy-ai / Wan2.1-quantized
  Wan2.1, quantized and optimized so it fits on your 3090/4090
  ☆34Updated 5 months ago
• deepbeepmeep / Cosmos1GP
  Cosmos1GP for the GPU Poor by DeepBeepMeep
  ☆74Updated 6 months ago
• Orion-zhen / abliteration
  Make abliterated models with transformers, easy and fast
  ☆83Updated 4 months ago
• deepbeepmeep / mmgp
  Memory Management for the GPU Poor, run the latest open source frontier models on consumer Nvidia GPUs
  ☆144Updated 2 weeks ago
• william-murray1204 / stable-diffusion-cpp-python
  stable-diffusion.cpp bindings for python
  ☆58Updated last month
• sdbds / SageAttention-for-windows
  Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossi…
  ☆49Updated 2 weeks ago
• Independent-AI-Labs / local-super-agents
  Privacy-first agentic framework with powerful reasoning & task automation capabilities. Natively distributed and fully ISO 27XXX complian…
  ☆66Updated 4 months ago
• S95Sedan / Deepspeed-Windows
  Deepspeed windows information
  ☆42Updated last year
• 5aharsh / collama
  Run Ollama LLM models in Google Colab for free
  ☆37Updated 9 months ago
• hasaranga / NativeChat
  win32 native frontend for llama-cli
  ☆12Updated 9 months ago
• JarodMica / GPT-SoVITS-Package
  1 min voice data can also be used to train a good TTS model! (few shot voice cloning)
  ☆29Updated 2 months ago
• RobViren / kvoicewalk
  A random walk voice style cloning application for Kokoro text to speech
  ☆117Updated 2 months ago
• alisson-anjos / YuE-exllamav2-UI
  ☆40Updated 6 months ago
• tercumantanumut / GameCompanionAI
  Game Companion AI is an advanced application designed to enhance the gaming experience by providing real-time analysis and interpretation…
  ☆52Updated 10 months ago
• rupeshs / sd3-low-vram
  Run Stable diffusion 3 on low VRAM systems
  ☆28Updated last year
• asaddi / f5-tts-serve
  A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…
  ☆15Updated 6 months ago
• NSFW-API / TripleX
  ☆205Updated 3 months ago