A framework for efficient model inference with omni-modality models
☆7,626Nov 8, 2026Updated this week
Alternatives and similar repositories for vllm-omni
Users that are interested in vllm-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High Performance Serving Runtime For Interactive Super Intelligence System☆1,716Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆38,577Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆96,551Updated this week
- Nano vLLM☆16,375Apr 26, 2026Updated 6 months ago
- FlashInfer: Kernel Library for LLM Serving☆6,883Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Remote control for Claude Code, Codex, Grok, and Cursor on Mac or PC. View sessions, send tasks, and drive them remotely from your phone,…☆2,239Updated this week
- The agent that remembers and learns.☆2,346Jul 18, 2026Updated 3 months ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆7,011Updated this week
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,539May 17, 2026Updated 5 months ago
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,313Updated this week
- Multimodal RL training framework for diffusion & omni models☆1,481Updated this week
- Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention☆3,122Updated this week
- State-of-the-art LLM compression, built for production inference with vLLM☆3,957Updated this week
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆24,174Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆1,330Jul 24, 2026Updated 3 months ago
- VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo☆2,287Updated this week
- Fast and memory-efficient exact attention☆25,258Updated this week
- A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for 100+ DiTs.☆1,302Updated this week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆8,933Updated this week
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizat…☆15,046Updated this week
- slime is an LLM training framework for RL Scaling.☆8,807Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,461Updated this week
- DeepSeek Harness 可编辑设计系统：AI 生成、可视化编辑、模板市场与 PPT｜Native Design & PPT Studio for DeepSeek Harness.☆1,773Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, im…☆4,096Apr 23, 2026Updated 6 months ago
- An open, programmable decision layer for models and compute.☆6,431Updated this week
- Evidence-driven Agent Skills for design award research, evaluation, award matching, entry writing, and submission readiness.☆710Aug 24, 2026Updated 2 months ago
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,063Updated this week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,901Updated this week
- A unified inference and post-training framework for accelerated video generation.☆4,794Updated this week
- Ongoing research training transformer models at scale☆18,349Updated this week
- a collection of skills for vllm-omni☆88Nov 2, 2026Updated last week
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆947Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- My learning notes for ML SYS.☆7,658Oct 21, 2026Updated 2 weeks ago
- xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism☆2,751Updated this week
- Lightweight Image Video Action Generation Inference Framework☆2,996Updated this week
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,892Sep 24, 2026Updated last month
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆3,283Updated this week
- DeepInfer: High-performance, large-scale inference framework for DeepSeek models☆25,730Updated this week
- DeepGEMM: clean and efficient BLAS kernel library on GPU☆9,177Oct 20, 2026Updated 3 weeks ago
Are these results useful?