fyabc / vllmLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆47Updated 3 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)☆144Updated 11 months ago
- Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.☆268Updated last month
- ☆242Updated 10 months ago
- The official repository of the dots.vlm1 instruct models proposed by rednote-hilab.☆277Updated 3 months ago
- ☆145Updated 5 months ago
- GLM Series Edge Models☆156Updated 7 months ago
- An initiative to replicate Sora☆104Updated last year
- ☆348Updated this week
- ☆187Updated 11 months ago
- Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.☆568Updated 2 months ago
- Cook up amazing multimodal AI applications effortlessly with MiniCPM-o☆231Updated last month
- ☆185Updated 5 months ago
- 基于通义千问 Qwen2.5-Omni 的实时语音对话系统，使用在线API服务，支持实时语音交互、动态语音活动检测和流式音频处理。A real-time voice conversation system based on Qwen2.5-Omni Online-API, …☆83Updated 8 months ago
- ☆29Updated last year
- Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation☆144Updated last year
- A third-party component library based on Gradio. Integrates Ant Design, Ant Design X, Monaco Editor and more advanced components to help…☆133Updated last month
- LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale (CVPR 2025)☆363Updated 2 months ago
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.☆164Updated 11 months ago
- ☆185Updated 11 months ago
- ☆79Updated last year
- project page for ChatAnyone☆116Updated 9 months ago
- SoulX-FlashTalk is the first 14B model to achieve sub-second start-up latency (0.87s) while maintaining a real-time throughput of 32 FPS …☆193Updated this week
- ComfyUI YOLO-World Integration☆48Updated last year
- Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…☆52Updated 2 years ago
- The official repo for "Vidi: Large Multimodal Models for Video Understanding and Editing"☆556Updated last month
- SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2☆133Updated last year
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines☆128Updated last year
- HumanOmni☆211Updated 10 months ago
- Our 2nd-gen LMM☆34Updated last year
- Multimodal chatbot with computer vision capabilities integrated, our 1st-gen LMM☆101Updated last year