fyabc / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆40Updated last month
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- ☆232Updated 4 months ago
- MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)☆135Updated 5 months ago
- Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.☆244Updated 4 months ago
- GLM Series Edge Models☆144Updated last month
- Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.☆375Updated this week
- 基于通义千问 Qwen2.5-Omni 的实时语音对话系统，使用在线API服务，支持实时语音交互、动态语音活动检测和流式音频处理。A real-time voice conversation system based on Qwen2.5-Omni Online-API, …☆59Updated 2 months ago
- A third-party component library based on Gradio.☆108Updated last week
- An initiative to replicate Sora☆104Updated last year
- ☆181Updated last month
- ☆164Updated this week
- ☆29Updated 10 months ago
- LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale (CVPR 2025)☆236Updated last week
- SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2☆123Updated 8 months ago
- Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation☆140Updated 8 months ago
- ☆173Updated 5 months ago
- project page for ChatAnyone☆110Updated 3 months ago
- A Toolkit for Running On-device Large Language Models (LLMs) in APP☆74Updated last year
- ☆164Updated 5 months ago
- ☆39Updated 8 months ago
- xllamacpp - a Python wrapper of llama.cpp☆44Updated last week
- Our 2nd-gen LMM☆33Updated last year
- Florence-2☆68Updated 5 months ago
- Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"☆131Updated 7 months ago
- Chinese Stable Diffusion, zh SD,中文文生图，中文SD，中文Stable Diffusion☆49Updated last year
- ☆80Updated last year
- Port of Facebook's LLaMA model in C/C++☆97Updated this week
- Implementation for the paper "ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systems".☆177Updated 4 months ago
- [ACL 2025 Oral] 🔥🔥 MegaPairs: Massive Data Synthesis for Universal Multimodal Retrieval☆203Updated last month
- ☆82Updated 2 weeks ago
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆255Updated 2 weeks ago