A high-throughput and memory-efficient inference and serving engine for LLMs
☆48Sep 18, 2025Updated 8 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- verl: Volcano Engine Reinforcement Learning for LLMs☆42Jun 23, 2025Updated 11 months ago
- Instance-level Facial Attributes Editing (CVIU 2021)☆15Jul 19, 2022Updated 3 years ago
- ICASSP2026 HumDial Challenge☆47May 28, 2026Updated 2 weeks ago
- ☆15Dec 20, 2024Updated last year
- StoryCraft is an app for generating high-quality user stories based on user prompts and other information. Its intuitive interface and na…☆17Aug 22, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ComfyUI-AniSora is now available in ComfyUI, Index-AniSora is the most powerful open-source animated video generation model. It enables o…☆56May 27, 2025Updated last year
- 使用fastrtc框架调用qwen-2.5-omni-realtime实现实时语音、视频等☆14Jun 27, 2025Updated 11 months ago
- A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.☆10Nov 6, 2021Updated 4 years ago
- Load and visualize different datasets in video question answering☆10May 11, 2021Updated 5 years ago
- ComfyUI QwenVL and Qwen wrapper☆143Nov 29, 2025Updated 6 months ago
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated last year
- A simple stable-audio-open-1.0 node for ComfyUI.☆35Aug 10, 2024Updated last year
- 基于通义千问 Qwen2.5-Omni 的实时语音对话系统，使用在线API服务，支持实时语音交互、动态语音活动检测和流式音频处理。A real-time voice conversation system based on Qwen2.5-Omni Online-API, …☆90May 11, 2025Updated last year
- Nodes for ComfyUI to simply workflows☆75May 19, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ComfyUI Nodes that integrate GLSL shader support.☆20Aug 25, 2025Updated 9 months ago
- QuantClaw is a plug-and-play task-type routing quantization plugin for OpenClaw.☆116Apr 27, 2026Updated last month
- ☆13Jun 26, 2023Updated 2 years ago
- Incremental Disentanglement for Environment-Aware Zero-Shot Text-to-Speech Synthesis☆27Mar 21, 2025Updated last year
- ComfyUI Node wrapper of SunoAI API☆20Dec 17, 2024Updated last year
- Scrape reddit posts into a single markdown file☆12Jul 28, 2024Updated last year
- About DeepSeek Chat API☆37Feb 23, 2025Updated last year
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Jan 29, 2024Updated 2 years ago
- ☆19Sep 5, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Awesome papers for affective computing with llm and mllm☆29Nov 26, 2025Updated 6 months ago
- AI Persona in JSON file☆17Jul 19, 2025Updated 10 months ago
- [ICLR 2026] Official repo for "Spotlight on Token Perception for Multimodal Reinforcement Learning"☆68Apr 3, 2026Updated 2 months ago
- Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and pe…☆4,020Jun 12, 2025Updated last year
- ComfyUI node that generates animated dotted waveform visualizations from audio input with multiple animation styles including teardrop-sh…☆31Apr 9, 2026Updated 2 months ago
- ☆11Feb 25, 2024Updated 2 years ago
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Oct 11, 2021Updated 4 years ago
- Create Video datasets to train your video models use YT or a video file path☆23Mar 17, 2025Updated last year
- ☆19Jun 11, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆42Mar 13, 2023Updated 3 years ago
- ComfyUI-HunyuanVideo-Avatar is now available in ComfyUI, HunyuanVideo-Avatar is a multimodal diffusion transformer (MM-DiT)-based model c…☆29May 29, 2025Updated last year
- ☆54Feb 6, 2026Updated 4 months ago
- The fastest way to launch Supabase SaaS apps using NextJS☆15Aug 17, 2023Updated 2 years ago
- 🔫 Interactive Goddess of Victory: NIKKE Spine Viewer☆31Nov 21, 2024Updated last year
- This project is the official implementation of 'DreamOmni3: Scribble-based Editing and Generation''☆40Dec 30, 2025Updated 5 months ago
- DARK_GLIGEN GUI using ComfyUI on the backend☆23Feb 18, 2024Updated 2 years ago