A high-throughput and memory-efficient inference and serving engine for LLMs
☆49Sep 18, 2025Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Nov 11, 2025Updated 11 months ago
- verl: Volcano Engine Reinforcement Learning for LLMs☆42Jun 23, 2025Updated last year
- 基于通义千问 Qwen2.5-Omni 的实时语音对话系统，使用在线API服务，支持实时语音交互、动态语音活动检测和流式音频处理。A real-time voice conversation system based on Qwen2.5-Omni Online-API, …☆92May 11, 2025Updated last year
- D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioning☆15Aug 4, 2026Updated 2 months ago
- Self Supervised Learning for Time Series Using Similarity Distillation☆11Jun 29, 2022Updated 4 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and pe…☆4,089Jun 12, 2025Updated last year
- [NAACL 2024] Official Implementation of paper "Self-Adaptive Sampling for Efficient Video Question Answering on Image--Text Models"☆12May 14, 2026Updated 5 months ago
- [ICCV 2025] Official implementation for Describe, Don't Dictate: Semantic Image Editing with Natural Language Intent☆15Nov 4, 2025Updated 11 months ago
- Official Code for AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration — Learning from Cheap, Optimizing…☆16May 12, 2026Updated 5 months ago
- Chinese-Mimi 是对 Moshi 模型的声码器进行了中文语料上的适配。☆39Mar 13, 2025Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆41Jan 26, 2025Updated last year
- Graph-based neural space weather forecasting☆15Oct 9, 2026Updated 3 weeks ago
- Real-time GPU image dithering in the browser via WebGL.☆17Oct 1, 2026Updated last month
- Zeta implementation of a reusable and plug in and play feedforward from the paper "Exponentially Faster Language Modeling"☆16Nov 11, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A curated list of research in machine learning system. I also summarize some papers if I think they are really interesting.☆12Nov 6, 2021Updated 4 years ago
- An MCP-enabled Qwen3 0.6B demo with adjustable thinking budget, all in your browser!☆28Jun 2, 2025Updated last year
- ☆14Mar 2, 2025Updated last year
- 使用django对情感分析功能进行封装，里面包含使用情感词典和Bert模型进行情感分类，最后可以使用tensorFlow serving将模型部署在docker中运行。☆13Sep 23, 2019Updated 7 years ago
- ☆21Nov 22, 2025Updated 11 months ago
- 中文 Python 笔记☆12Jan 15, 2018Updated 8 years ago
- Serving Next Generation Experimental Tracking for Machine Learning Operations☆15Mar 5, 2026Updated 7 months ago
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Oct 11, 2021Updated 5 years ago
- WavReward: Spoken Dialogue Models With Generalist Reward Evaluators☆57May 15, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- UFT: Unifying Supervised and Reinforcement Fine-Tuning☆34Jun 30, 2025Updated last year
- Attention-Based Encoder-Decoder Target-Speaker Voice Activity Detection for Robust Speaker Diarization☆36Sep 22, 2025Updated last year
- Implementation of Sesame's Conversational Speech Model for Hugging Face Transformers☆58May 17, 2025Updated last year
- generation of training-optimised weather datasets from declarative syntax☆17Oct 25, 2026Updated last week
- Revision of official yolov7-pose to support custom dataset for keypoint detection☆11Nov 12, 2023Updated 2 years ago
- Benchmark Dataset for Advancing Machine Learning in Heliophysics and Space Weather Prediction☆16Dec 6, 2025Updated 10 months ago
- Official Repository of Paper: "Emilia-NV: A Non-Verbal Speech Dataset with Word-Level Annotation for Human-Like Speech Modeling"☆96Sep 18, 2025Updated last year
- ☆17Nov 1, 2024Updated 2 years ago
- ☆39Jun 9, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆20Dec 11, 2025Updated 10 months ago
- The implementation of Text Classification with Negative Supervision (ACL, 2020)☆10Oct 8, 2020Updated 6 years ago
- Official implementation for "Causal Intervention for Subject-Deconfounded Facial Action Unit Recognition" (AAAI 2022 Oral).☆17Mar 11, 2025Updated last year
- MeloTTS demo on Axera☆14Jul 1, 2026Updated 4 months ago
- Implementation of the paper "Variable Bitrate Residual Vector Quantization for Audio Coding"☆11Apr 10, 2025Updated last year
- A UI based LLM fine-tuning. It can fine-tune latest open-sourced LLMs on cloud instances (aws) with user defined settings, merge multiple…☆10Jul 23, 2025Updated last year
- [NeurIPS 2024] SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words☆56Jun 25, 2024Updated 2 years ago