A high-throughput and memory-efficient inference and serving engine for LLMs
☆46Oct 16, 2026Updated last month
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Review of Deep-Learning-based Singing Voice Synthesis Approaches☆13Oct 3, 2026Updated last month
- [EMNLP 2026] One-Stage Multi-Task Instruction-Guided 3D Spatial Audio Editing☆19Oct 19, 2026Updated last month
- ☆13Mar 30, 2023Updated 3 years ago
- 中国象棋相关的工具,包含3个命令行程序: xiangqi-fen2text, xiangqi-fen2pic, xiangqi-ubb2fen☆11Mar 12, 2018Updated 8 years ago
- [ACL 2026] Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models☆22May 23, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Eureka-Audio: A 1.7B lightweight audio–language model that matches 7B–30B models on ASR, audio understanding, and paralinguistic reasonin…☆50Apr 11, 2026Updated 7 months ago
- Production first, nn-based on-device signal processing toolkit.☆63May 30, 2023Updated 3 years ago
- Step-Audio 2 is an end-to-end multi-modal large language model designed for industry-strength audio understanding and speech conversation…☆1,531Mar 16, 2026Updated 8 months ago
- A Python inference library and HTTP service for AudioJev. Provide an audio clip and natural-language questions to get candidate probabili…☆21Oct 30, 2026Updated 3 weeks ago
- Plug-and-Play Clarifier: A Zero-Shot Multimodal Framework for Egocentric Intent Disambiguation (AAAI 2026)☆15Aug 16, 2026Updated 3 months ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- ☆703Apr 29, 2026Updated 6 months ago
- ☆14Jul 1, 2024Updated 2 years ago
- offical code for Dense-TSNet☆11Sep 17, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PyTorch implementation of TinyWASE described in our paper "Compressing Speaker Extraction Model with Ultra-low Precision Quantization and…☆11Jun 28, 2021Updated 5 years ago
- Lightning-responsive CosyVoice streaming API based on FastAPI.☆29Aug 17, 2026Updated 3 months ago
- The implementation of MDNet, which is in submission to Interspeech2022☆14May 1, 2022Updated 4 years ago
- ☆18Sep 19, 2025Updated last year
- GFGE☆15Sep 7, 2022Updated 4 years ago
- ☆395Jan 28, 2026Updated 9 months ago
- ☆10Sep 12, 2024Updated 2 years ago
- ☆453Aug 10, 2025Updated last year
- Model-based Hindsight Experience Replay☆10Jun 8, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Aug 10, 2022Updated 4 years ago
- Transformers components but in Triton☆35May 9, 2025Updated last year
- ☆23Jul 26, 2025Updated last year
- TLS/SSL and crypto library☆15Mar 19, 2021Updated 5 years ago
- ☆10Jun 28, 2024Updated 2 years ago
- ☆21Apr 2, 2025Updated last year
- The source code of Tim-TSENet☆15Apr 22, 2022Updated 4 years ago
- This is the implementation of the manuscript "Learning General All-Neural Speech Enhancement based on Taylor's Approximation Theory", whi…☆14Nov 25, 2022Updated 3 years ago
- A powerful 3B-parameter, LLM-based Reinforcement Learning audio edit model excels at editing emotion, speaking style, and paralinguistics…☆1,005Apr 9, 2026Updated 7 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- This is not remotely close to a finished product, and does not intend to nor does this claim to be working fine-tuning code for MaskGCT. …☆13Dec 4, 2024Updated last year
- ☆25Oct 19, 2026Updated last month
- ☆65Oct 19, 2025Updated last year
- Accepted to MLSys 2026☆98Apr 19, 2026Updated 7 months ago
- gym_fetch_env with insert drawer open door☆12Mar 22, 2022Updated 4 years ago
- 仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记【文本匹配篇】☆13Jul 9, 2022Updated 4 years ago
- 该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记【Bert篇】☆13Apr 4, 2023Updated 3 years ago
Are these results useful?