Agent skills for vLLM
☆103Apr 3, 2026Updated 6 months ago
Alternatives and similar repositories for vllm-skills
Users that are interested in vllm-skills are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a collection of skills for vllm-omni☆87Updated this week
- vLLM Daily Summarization of Merged PRs☆56Updated this week
- vLLM plugin for block-based diffusion language model (dLLM) support☆28May 25, 2026Updated 5 months ago
- vLLM Model plugin for the encoder-decoder BART model☆13Oct 23, 2026Updated last week
- ☆18Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A high-performance and light-weight router for vLLM large scale deployment☆490Updated this week
- A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.☆22Updated this week
- vLLM plugin for attention-ffn disaggregation support☆241Updated this week
- Alibaba Cloud's high-performance KVCache system for LLM inference, with components for global cache management, inference simulation(HiSi…☆275Updated this week
- ☆48Updated this week
- A unified workflow orchestration and distributed KV cache sharing framework for multimodal inference.☆38Sep 4, 2026Updated last month
- ☆13Feb 11, 2025Updated last year
- Multimodal RL training framework for diffusion & omni models☆1,413Updated this week
- An LLM post-training framework with vLLM for RL Scaling☆492Oct 14, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- The vLLM XPU kernels for Intel GPU☆80Updated this week
- Implemented and benchmarked KV cache compression methods for LLM inference in Triton. Optimized kernels for KIVI and TurboQuant with Flas…☆18Jun 19, 2026Updated 4 months ago
- Claude Code agent skills for writing optimized Triton GPU kernels☆15Mar 6, 2026Updated 7 months ago
- Offline optimization of your disaggregated Dynamo graph☆461Updated this week
- A framework for efficient model inference with omni-modality models☆7,420Updated this week
- ☆34Jul 13, 2026Updated 3 months ago
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- Ulysses sequence-parallel all-to-all as a torch custom op, moved by the GPU copy engines into torch symmetric memory. Zero SM usage; 1.66…☆54Aug 25, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Performance benchmark & accuracy evaluation for vLLM☆17Oct 17, 2026Updated 2 weeks ago
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated 11 months ago
- Optimize the performance of LLM inference engines by automatically tuning parameters for a specific model.☆14Updated this week
- Easy, Fast, and Scalable Multimodal AI☆135Jun 2, 2026Updated 4 months ago
- Stateful API logic for agentic applications using vLLM☆339Updated this week
- Common recipes to run vLLM☆1,075Updated this week
- High-performance KV cache storage for LLM inference — GPU offloading, SSD caching, and cross-node sharing via RDMA. Works with vLLM and S…☆219Updated this week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,731Updated this week
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,878Sep 24, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Systematic and comprehensive benchmarks for LLM systems.☆61Jan 28, 2026Updated 9 months ago
- Kubernetes enhancements for Network Topology Aware Gang Scheduling & Autoscaling☆284Updated this week
- 面向数据领域专业人士的skills技能库，个人平常使用☆16Jun 17, 2026Updated 4 months ago
- ☆28Mar 31, 2026Updated 7 months ago
- High Performance LLM Inference Operator Library☆1,186Sep 7, 2026Updated last month
- ☆24Jul 20, 2026Updated 3 months ago
- ☆1,089Updated this week