A high-throughput and memory-efficient inference and serving engine for LLMs
☆49Sep 18, 2025Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- verl: Volcano Engine Reinforcement Learning for LLMs☆42Jun 23, 2025Updated last year
- Instance-level Facial Attributes Editing (CVIU 2021)☆15Jul 19, 2022Updated 4 years ago
- ☆10Jul 1, 2024Updated 2 years ago
- ☆16Nov 11, 2025Updated 10 months ago
- ☆15Dec 20, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 使用fastrtc框架调用qwen-2.5-omni-realtime实现实时语音、视频等☆14Jun 27, 2025Updated last year
- Load and visualize different datasets in video question answering☆10May 11, 2021Updated 5 years ago
- A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.☆12Nov 6, 2021Updated 4 years ago
- ☆12Feb 19, 2025Updated last year
- An MCP-enabled Qwen3 0.6B demo with adjustable thinking budget, all in your browser!☆28Jun 2, 2025Updated last year
- 基于通义千问 Qwen2.5-Omni 的实时语音对话系统，使用在线API服务，支持实时语音交互、动态语音活动检测和流式音频处理。A real-time voice conversation system based on Qwen2.5-Omni Online-API, …☆92May 11, 2025Updated last year
- 🎥 AI-powered webinar platform with live streaming, smart breakout rooms, and autonomous sales agents.☆13Jun 21, 2025Updated last year
- ☆19Oct 5, 2025Updated 11 months ago
- ☆18Dec 17, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- TinyWall is a free, non-intrusive, secure-by-default firewall for Windows.☆12Jun 18, 2026Updated 3 months ago
- ☆55Dec 23, 2024Updated last year
- ☆13Jun 26, 2023Updated 3 years ago
- Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)☆16Apr 23, 2024Updated 2 years ago
- ☆14Jul 17, 2024Updated 2 years ago
- ComfyUI QwenVL and Qwen wrapper☆145Nov 29, 2025Updated 9 months ago
- [NeurIPS 2023 (Spotlight)] Uncovering the Hidden Dynamics of Video Self-supervised Learning under Distribution Shifts☆13Jan 30, 2024Updated 2 years ago
- A GUI-first evaluation workbench for local LLMs running on Ollama. Build personal test suites, run sequential evaluations across installe…☆19Apr 20, 2026Updated 5 months ago
- Making ComfyUI more comfortable!☆19Sep 13, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆30May 12, 2026Updated 4 months ago
- 中文 Python 笔记☆12Jan 15, 2018Updated 8 years ago
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Oct 11, 2021Updated 4 years ago
- Automatic defect recognition in X-ray testing using computer vision☆12Dec 8, 2018Updated 7 years ago
- A Python script to display PNG images (e.g. from StableDiffusion) and extract prompt, negative prompt, and settings from text chunks. Off…☆22Apr 9, 2025Updated last year
- Deploy Jupyter Notebook to AWS Lambda☆16Nov 18, 2020Updated 5 years ago
- A ComfyUI custom node enabling **Flash Attention 1** on legacy NVIDIA GPUs (Tesla V100, T4) that lack Compute Capability 8.0+ required by…☆28Feb 9, 2026Updated 7 months ago
- Next generation face swapper and enhancer☆17Aug 8, 2024Updated 2 years ago
- ComfyUI Node wrapper of SunoAI API☆22Dec 17, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- generation of training-optimised weather datasets from declarative syntax☆17Feb 28, 2026Updated 6 months ago
- Download workflow here☆18Feb 25, 2026Updated 6 months ago
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and pe…☆4,075Jun 12, 2025Updated last year
- 💡💡💡awesome compute vision app in gradio☆60May 17, 2024Updated 2 years ago
- Space Weather Monitor Application (SWMA) is an open-source application made for visualizing real-time space weather related data.☆19Oct 12, 2023Updated 2 years ago
- Run a 105 GB AI model on a 48 GB Mac. Qwen3.8-Flash-Next (125B mixture of experts) streams its experts from SSD through a slot cache. Nat…☆392Updated this week