☆226Nov 19, 2025Updated 3 months ago
Alternatives and similar repositories for flash-moba
Users that are interested in flash-moba are comparing it to the libraries listed below
Sorting:
- NVIDIA cuTile learn☆165Dec 9, 2025Updated 2 months ago
- ☆30Dec 31, 2025Updated 2 months ago
- ☆35Mar 7, 2025Updated 11 months ago
- Xmixers: A collection of SOTA efficient token/channel mixers☆28Sep 4, 2025Updated 6 months ago
- Quantized Attention on GPU☆44Nov 22, 2024Updated last year
- ☆136May 29, 2025Updated 9 months ago
- Distributed MoE in a Single Kernel [NeurIPS '25]☆194Feb 27, 2026Updated last week
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆269Jul 6, 2025Updated 8 months ago
- ☆22May 5, 2025Updated 10 months ago
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆969Feb 5, 2026Updated last month
- [ASPLOS'26] Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter☆149Feb 27, 2026Updated last week
- ☆272Jun 6, 2025Updated 9 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆239Jun 15, 2025Updated 8 months ago
- [NeurIPS'25 Spotlight] Adaptive Attention Sparsity with Hierarchical Top-p Pruning☆88Nov 29, 2025Updated 3 months ago
- ☆65Apr 26, 2025Updated 10 months ago
- Efficient Long-context Language Model Training by Core Attention Disaggregation☆92Updated this week
- A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention☆284Dec 1, 2025Updated 3 months ago
- A sparse attention kernel supporting mix sparse patterns☆472Jan 18, 2026Updated last month
- DeeperGEMM: crazy optimized version☆74May 5, 2025Updated 10 months ago
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training☆260Aug 9, 2025Updated 6 months ago
- [NeurIPS 2025] ClusterFusion: Expanding Operator Fusion Scope for LLM Inference via Cluster-Level Collective Primitive☆66Dec 11, 2025Updated 2 months ago
- [ICLR 2025, IEEE TPAMI 2026] Mixture Compressor & MC#☆68Feb 12, 2025Updated last year
- ☆52May 19, 2025Updated 9 months ago
- 🚀 Efficient implementations of state-of-the-art linear attention models☆4,474Updated this week
- Fast and memory-efficient exact kmeans☆140Feb 18, 2026Updated 2 weeks ago
- The Official Implementation of Ada-KV [NeurIPS 2025]☆128Nov 26, 2025Updated 3 months ago
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆527Feb 10, 2025Updated last year
- Distributed Compiler based on Triton for Parallel Systems☆1,371Feb 13, 2026Updated 3 weeks ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆51Jul 4, 2025Updated 8 months ago
- ☆14Oct 3, 2024Updated last year
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆129Jun 24, 2025Updated 8 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆293Nov 7, 2025Updated 4 months ago
- SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention☆284Feb 24, 2026Updated last week
- [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference☆283May 1, 2025Updated 10 months ago
- [ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.☆952Feb 25, 2026Updated last week
- [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference☆374Jul 10, 2025Updated 7 months ago
- Vortex: A Flexible and Efficient Sparse Attention Framework☆48Jan 21, 2026Updated last month
- ☆105Nov 7, 2024Updated last year
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆110Oct 11, 2025Updated 4 months ago