A high-throughput and memory-efficient inference and serving engine for LLMs
☆49Sep 18, 2025Updated 10 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- verl: Volcano Engine Reinforcement Learning for LLMs☆42Jun 23, 2025Updated last year
- ☆10Jul 1, 2024Updated 2 years ago
- Self Supervised Learning for Time Series Using Similarity Distillation☆11Jun 29, 2022Updated 4 years ago
- ☆16Nov 11, 2025Updated 8 months ago
- 使用fastrtc框架调用qwen-2.5-omni-realtime实现实时语音、视频等☆14Jun 27, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- VPTracker: Global Vision-Language Tracking via Visual Prompt and MLLM☆16Mar 10, 2026Updated 4 months ago
- ☆12Feb 19, 2025Updated last year
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated 2 years ago
- An MCP-enabled Qwen3 0.6B demo with adjustable thinking budget, all in your browser!☆28Jun 2, 2025Updated last year
- 基于通义千问 Qwen2.5-Omni 的实时语音对话系统，使用在线API服务，支持实时语音交互、动态语音活动检测和流式音频处理。A real-time voice conversation system based on Qwen2.5-Omni Online-API, …☆91May 11, 2025Updated last year
- TinyWall is a free, non-intrusive, secure-by-default firewall for Windows.☆12Jun 18, 2026Updated last month
- ☆54Dec 23, 2024Updated last year
- Nodes for ComfyUI to simply workflows☆76Jun 29, 2026Updated 3 weeks ago
- Invariant Feature Regularization for Fair Face Recognition (ICCV'23)☆15Oct 23, 2023Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆13Jan 17, 2024Updated 2 years ago
- 🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform☆38Jan 29, 2024Updated 2 years ago
- ComfyUI QwenVL and Qwen wrapper☆145Nov 29, 2025Updated 7 months ago
- Scripts help setup a clean install of ComfyUI and supporting tools☆26Aug 19, 2024Updated last year
- 使用django对情感分析功能进行封装，里面包含使用情感词典和Bert模型进行情感分类，最后可以使用tensorFlow serving将模型部署在docker中运行。☆13Sep 23, 2019Updated 6 years ago
- ☆16Jul 12, 2024Updated 2 years ago
- [NeurIPS 2023 (Spotlight)] Uncovering the Hidden Dynamics of Video Self-supervised Learning under Distribution Shifts☆13Jan 30, 2024Updated 2 years ago
- UFT: Unifying Supervised and Reinforcement Fine-Tuning☆31Jun 30, 2025Updated last year
- Incremental Disentanglement for Environment-Aware Zero-Shot Text-to-Speech Synthesis☆27Mar 21, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- View components and APIs that work web, mobile and native!☆14Jan 20, 2018Updated 8 years ago
- Making ComfyUI more comfortable!☆19Sep 13, 2025Updated 10 months ago
- ☆30May 12, 2026Updated 2 months ago
- 中文 Python 笔记☆12Jan 15, 2018Updated 8 years ago
- ComfyUI Nodes that integrate GLSL shader support.☆20Aug 25, 2025Updated 11 months ago
- Automatic defect recognition in X-ray testing using computer vision☆13Dec 8, 2018Updated 7 years ago
- A Python script to display PNG images (e.g. from StableDiffusion) and extract prompt, negative prompt, and settings from text chunks. Off…☆21Apr 9, 2025Updated last year
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆15Feb 9, 2026Updated 5 months ago
- ComfyUI Node wrapper of SunoAI API☆21Dec 17, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆13Apr 9, 2025Updated last year
- ☆11Feb 25, 2024Updated 2 years ago
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆57Jun 25, 2024Updated 2 years ago
- ☆14Jan 20, 2025Updated last year
- Summarize SEC documents using LLMs☆14Aug 23, 2023Updated 2 years ago
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- LearnWeb3: How to build an on-chain DAO with automatic proposal execution. Workshop done for ETHGlobal DAOHacks☆10Apr 7, 2022Updated 4 years ago