A lightweight `vLLM-Omni`-style diffusion implementation built around `Wan2.2-TI2V-5B-Diffusers` inspired from nano-vllm
☆64May 25, 2026Updated 4 months ago
Alternatives and similar repositories for nano-vllm-omni
Users that are interested in nano-vllm-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A unified workflow orchestration and distributed KV cache sharing framework for multimodal inference.☆38Sep 4, 2026Updated last month
- A vLLM-inspired inference engine for looped transformers, with loop-level scheduling and execution across composable stages☆201Updated this week
- A from-scratch Prefill/Decode disaggregation inference engine for LLMs☆162May 10, 2026Updated 5 months ago
- ☆15Mar 11, 2026Updated 7 months ago
- ☆426Sep 16, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill☆101Jan 26, 2026Updated 8 months ago
- A sparse-first inference engine (SparseEngine).☆103Updated this week
- Super fast serving stack for LLM on Windows/Linux/Macos☆17Oct 15, 2026Updated last week
- [NSDI'26] PolyRL is a reinforcement learning framework for LLM that harvest spot instances on the cloud to reduce cost.☆19Mar 30, 2026Updated 6 months ago
- a collection of skills for vllm-omni☆87Updated this week
- DeepSeek-V4 Lecture☆31Aug 10, 2026Updated 2 months ago
- 野火STM32H743 挑战者开发板 教程配套代码☆16Sep 2, 2020Updated 6 years ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 10 months ago
- ☆32Sep 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This repository is inspired by nano-vllm. Thanks! The core improvements include a CUDA-based Add+RMSNorm fused kernel, Chunked Prefill fo…☆36Sep 12, 2026Updated last month
- Draft-Target Disaggregation LLM Serving System via Parallel Speculative Decoding.☆223Mar 18, 2026Updated 7 months ago
- The repository for the 2024 IEEE Cloud Submission of OS4C☆10Oct 22, 2024Updated 2 years ago
- The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221☆32Apr 22, 2025Updated last year
- Awesome VLN paper list☆28Sep 18, 2026Updated last month
- Virtual Decoupled Cores: Composable Programming Framework and Runtime for Async GPUs☆25Updated this week
- A framework for efficient model inference with omni-modality models☆7,302Updated this week
- ☆44Updated this week
- An open-source toolkit for BigMac-style pipeline-parallel training of multimodal large language models.☆37Jul 21, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- vLLM plugin for block-based diffusion language model (dLLM) support☆28May 25, 2026Updated 4 months ago
- Frontier: A Discrete-Event Simulator for Modern LLM Serving☆167Updated this week
- SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs☆70Mar 25, 2025Updated last year
- Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.☆1,431Updated this week
- In-Memory Key-Value Store Live Migration with NetMigrate☆19Jun 22, 2024Updated 2 years ago
- This is the implementation repository of our SOSP'24 paper: Aceso: Achieving Efficient Fault Tolerance in Memory-Disaggregated Key-Value …☆24Oct 20, 2024Updated 2 years ago
- community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance☆61Updated this week
- Implementation for ACL 2024 paper "Meta-Task Prompting Elicits Embeddings from Large Language Models"☆12Jul 25, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-…☆17Updated this week
- vLLM Daily Summarization of Merged PRs☆56Oct 12, 2026Updated last week
- [OSDI 2024] Motor: Enabling Multi-Versioning for Distributed Transactions on Disaggregated Memory☆50Mar 3, 2024Updated 2 years ago
- ☆20Jan 9, 2025Updated last year
- Interactive 3D model of NVIDIA Vera Rubin hardware (superchip, NVL72 compute tray, HGX NVL8) with connection tracing and a guided tour☆16Oct 1, 2026Updated 3 weeks ago
- OpenAI-compatible speech serving in Rust: streaming TTS and full-duplex voice over GPT-Live. 128 concurrent PersonaPlex sessions on one G…☆47Sep 30, 2026Updated 3 weeks ago
- ☆11May 13, 2025Updated last year