a collection of skills for vllm-omni
☆88Nov 2, 2026Updated last week
Alternatives and similar repositories for vllm-omni-skills
Users that are interested in vllm-omni-skills are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A framework for efficient model inference with omni-modality models☆7,626Updated this week
- vLLM Daily Summarization of Merged PRs☆56Updated this week
- Fast and memory-efficient exact attention☆23Oct 27, 2026Updated 2 weeks ago
- ☆175Mar 5, 2026Updated 8 months ago
- An LLM post-training framework with vLLM for RL Scaling☆503Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- High Performance Serving Runtime For Interactive Super Intelligence System☆1,716Updated this week
- A lightweight `vLLM-Omni`-style diffusion implementation built around `Wan2.2-TI2V-5B-Diffusers` inspired from nano-vllm☆66May 25, 2026Updated 5 months ago
- ☆14Jan 27, 2026Updated 9 months ago
- Multimodal RL training framework for diffusion & omni models☆1,481Updated this week
- A PyTorch-native inference engine with cache, parallelism, quantization and cpu offload for 100+ DiTs.☆1,302Updated this week
- ☆16May 16, 2026Updated 5 months ago
- [ACL 2026 Findings] Living repository for the survey paper “Efficient Inference for Large Vision-Language Models: Bottlenecks, Techniques…☆35Oct 20, 2026Updated 3 weeks ago
- DLBlas: clean and efficient kernels☆46Nov 3, 2026Updated last week
- Prototyp MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism☆35Apr 4, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A simple tomasulo simulator written in Rust for the course Computer Architecture.☆14Dec 29, 2022Updated 3 years ago
- PyTorch Tutorial to train ConvNets for Image Classification.☆11May 20, 2021Updated 5 years ago
- AmphionASR: Personalized Context-Aware Speech Recognition☆13Jul 28, 2026Updated 3 months ago
- AISimulate predicts LLM serving behavior and searches for strong deployment configurations offline, without bringing up a GPU serving clu…☆125Updated this week
- ☆13Oct 27, 2026Updated 2 weeks ago
- A high-performance and light-weight router for vLLM large scale deployment☆504Updated this week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,901Updated this week
- Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.☆1,556Oct 19, 2026Updated 3 weeks ago
- verl Zero-Mismatch Dense/MoE HuggingFace Rollout☆76Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆14Mar 18, 2026Updated 7 months ago
- On-device speech AI runtime for ASR, TTS, VAD, and voice cloning. Python-simple, C++-native, GGUF-powered.☆32Aug 7, 2026Updated 3 months ago
- [EMNLP2026 Main] Official implementation of “Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding”.☆141Jul 25, 2026Updated 3 months ago
- ☆11Nov 7, 2023Updated 3 years ago
- Autonomous GPU Kernel Generation & Optimization via Deep Agents☆622Sep 8, 2026Updated 2 months ago
- Carry your bot messages on the fly☆20Updated this week
- An official implementation of "SpatialASM: Internalizing Active Mentalization for Spatial Reasoning"☆29Oct 17, 2026Updated 3 weeks ago
- ☆277Oct 14, 2026Updated 3 weeks ago
- ☆1,147Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Expert-parallel communication for Attention–FFN Disaggregation (AFD), built on DeepEP V2☆16Updated this week
- Voxtral Codec : Combining Semantic VQ and Acoustic FSQ for Ultra-Low Bitrate Speech Generation (Voxtral TTS Backbone)☆18Updated this week
- Finetuning LLaMA with DeepSpeed☆10Apr 14, 2023Updated 3 years ago
- [ACL 2026 Main] See the Forest for the Trees: Loosely Speculative Decoding via Visual-Semantic Guidance for Efficient Inference of Video …☆32Jul 4, 2026Updated 4 months ago
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆1,278Updated this week
- [ICML 2025] Efficiently Serving Large Multimodal Models Using EPD Disaggregation☆28Jul 11, 2026Updated 3 months ago
- ☆121Updated this week
Are these results useful?