A Triton-only attention backend for vLLM
☆28Jul 14, 2026Updated 3 months ago
Alternatives and similar repositories for vllm-triton-backend
Users that are interested in vllm-triton-backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- ☆32Jul 2, 2025Updated last year
- ☆20May 24, 2025Updated last year
- GPU Kernel Manager Operator☆12Oct 1, 2026Updated last month
- ☆12May 8, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- Framework to reduce autotune overhead to zero for well known deployments.☆101Sep 19, 2025Updated last year
- ☆11Updated this week
- A formally-verified compiler IR☆10May 5, 2026Updated 5 months ago
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- ☆10Apr 14, 2026Updated 6 months ago
- Sample Codes using NVSHMEM on Multi-GPU☆30Jan 22, 2023Updated 3 years ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NaiveRT: a self-contained TP8 inference runtime for the Naive N series on eight Blackwell GPUs with UMMA support. One persistent CUDA gra…☆119Sep 27, 2026Updated last month
- Tenstorrent Plugin for Triton☆14Aug 25, 2026Updated 2 months ago
- HOA (Humanfia Olympiad Agents): PutnamBench and olympiad problems (IMO, IOI, IPhO, IChO, IBO) solved by agents, checked in Lean 4 where p…☆19Oct 19, 2026Updated 2 weeks ago
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- SC'25 UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling☆16Aug 14, 2025Updated last year
- Development containers for triton and triton-cpu☆31Oct 1, 2026Updated last month
- ☆68Feb 24, 2026Updated 8 months ago
- ☆17Jun 4, 2026Updated 5 months ago
- High-performance RDMA for Python and PyTorch (ibverbs, efa, NVMe-oF)☆14Sep 2, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer☆208Feb 11, 2026Updated 8 months ago
- ☆12May 11, 2025Updated last year
- ☆28May 9, 2025Updated last year
- ☆54May 19, 2025Updated last year
- ☆46Oct 15, 2025Updated last year
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 6 months ago
- incubator repo for CUDA-TileIR backend☆166Oct 8, 2026Updated 3 weeks ago
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆79Aug 8, 2026Updated 2 months ago
- ☆12Nov 21, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Jul 10, 2026Updated 3 months ago
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆203Oct 28, 2026Updated last week
- NVIDIA cuTile learn☆168Dec 9, 2025Updated 10 months ago
- Github mirror of trition-lang/triton repo.☆205Updated this week
- ☆48Nov 1, 2025Updated last year
- FLA but cuTile☆27Apr 17, 2026Updated 6 months ago
- ☆22May 30, 2026Updated 5 months ago