A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)
☆13Aug 15, 2026Updated 2 months ago
Alternatives and similar repositories for vllm-windows
Users that are interested in vllm-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 一个语音识别项目☆51May 13, 2025Updated last year
- An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System☆18Aug 15, 2026Updated 2 months ago
- Semantic Conditioning Bridge for MiniMax H3☆37Sep 14, 2026Updated last month
- ☆20Oct 29, 2018Updated 7 years ago
- Implementation of End-to-End YOLO Models☆10Dec 30, 2025Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆21Oct 19, 2025Updated last year
- ☆13Aug 26, 2025Updated last year
- KernelMode Mono/win32/win64 dll injector and driver☆10Mar 27, 2021Updated 5 years ago
- A sparse attention kernel supporting mix sparse patterns☆29May 20, 2026Updated 5 months ago
- Workflow-to-APP、ScreenShare&FloatingVideo、GPT & 3D、SpeechRecognition&TTS☆48May 11, 2026Updated 5 months ago
- D3DSample☆11Apr 22, 2020Updated 6 years ago
- ☆15Jul 23, 2025Updated last year
- ComfyUI custom nodes for MatAnyone2 video matting☆18Mar 24, 2026Updated 6 months ago
- Refusal in Language Models☆44Oct 2, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A script to download all the available tweets from a Twitter user☆43Dec 8, 2022Updated 3 years ago
- Bagel but with Gradio Interface☆20May 21, 2025Updated last year
- stock股票.获取股票数据,计算股票指标,筹码分布,识别股票形态,综合选股,选股策略,股票验证回测,股票自动交易,支持PC及移动设备。☆39Aug 28, 2025Updated last year
- 免费开源 Windows Edge TTS GUI：文字转 MP3、实时进度、网络诊断、中英文界面与白夜主题 | Free open-source Windows Edge TTS GUI.☆52Updated this week
- ☆26Sep 8, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs (Windows build & kernels)☆670Oct 13, 2026Updated last week
- Trojan Panel Frontend / Trojan Panel 前端☆11May 9, 2025Updated last year
- Web GUI for audio.cpp☆41Sep 18, 2026Updated last month
- Pre-compiled acceleration packages (xFormers, SageAttention, Flash Attention) for ComfyUI on Windows — NVIDIA RTX 5000 Series (Blackwell,…☆59May 13, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Confucius4-R2T2 GGUF Q8 speech-to-text nodes for ComfyUI (Windows/CUDA)☆16Updated this week
- 把小说角色变成"活人"：每个角色是一个独立模拟体，只知道他该知道的，怕他该怕的，说他自己的话。 剧情线是引力场，不是铁轨——角色自由行动，世界只用"世界内的手段"把故事拉向既定节点。☆55Sep 13, 2026Updated last month
- ☆14Sep 28, 2023Updated 3 years ago
- lucky_seed☆11Nov 2, 2025Updated 11 months ago
- ☆12Dec 13, 2022Updated 3 years ago
- ☆30Sep 18, 2026Updated last month
- global mouse and keyboard hook☆13Jul 24, 2019Updated 7 years ago
- WeiLin-Comfyui-Tools-panel☆11Feb 9, 2025Updated last year
- Awakening Spatial Intelligence in Unified Multimodal Understanding and Generation☆14Apr 18, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Official supplementary code for Mogo: RQ Hierarchical Causal Transformer for High-Quality 3D Human Motion Generation, an autoregressive m…☆13May 2, 2026Updated 5 months ago
- Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tool…☆21Sep 9, 2026Updated last month
- ☆15Jan 11, 2026Updated 9 months ago
- Deforum extension for stable-diffusion-webui-forge☆41May 1, 2024Updated 2 years ago
- Official implementation of OmnimatteZero: Training-Free Video Matting and Compositing via Latent Diffusion Models☆20Feb 12, 2026Updated 8 months ago
- 为了实现懒惰的框架☆20Nov 4, 2024Updated last year
- ☆11May 6, 2025Updated last year