☆136May 29, 2025Updated 9 months ago
Alternatives and similar repositories for grouped-latent-attention
Users that are interested in grouped-latent-attention are comparing it to the libraries listed below
Sorting:
- ☆22May 5, 2025Updated 10 months ago
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆269Jul 6, 2025Updated 8 months ago
- ☆227Nov 19, 2025Updated 3 months ago
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆129Jun 24, 2025Updated 8 months ago
- ☆52May 19, 2025Updated 9 months ago
- ☆61Nov 27, 2023Updated 2 years ago
- The evaluation framework for training-free sparse attention in LLMs☆121Jan 27, 2026Updated last month
- ☆15Jan 12, 2026Updated last month
- Quantized Attention on GPU☆44Nov 22, 2024Updated last year
- [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models☆17Nov 4, 2025Updated 4 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆42Dec 29, 2025Updated 2 months ago
- Code for the paper "Function-Space Learning Rates"☆25Jun 3, 2025Updated 9 months ago
- ☆272Jun 6, 2025Updated 9 months ago
- ☆27Feb 26, 2026Updated last week
- study of cutlass☆22Nov 10, 2024Updated last year
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆35Mar 7, 2025Updated last year
- ☆15Mar 2, 2025Updated last year
- ☆53May 20, 2024Updated last year
- Helpful tools and examples for working with flex-attention☆1,140Feb 8, 2026Updated last month
- Odysseus: Playground of LLM Sequence Parallelism☆79Jun 17, 2024Updated last year
- ☆123Feb 4, 2026Updated last month
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Jun 6, 2024Updated last year
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆974Feb 5, 2026Updated last month
- VideoNSA: Native Sparse Attention Scales Video Understanding☆81Nov 16, 2025Updated 3 months ago
- Benchmark tests supporting the TiledCUDA library.☆18Nov 19, 2024Updated last year
- ☆15Sep 22, 2024Updated last year
- [ICLR-2026] Official Implementation of our paper "THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoning".☆32Feb 26, 2026Updated last week
- ☆65Apr 26, 2025Updated 10 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆239Jun 15, 2025Updated 8 months ago
- An experimental communicating attention kernel based on DeepEP.☆35Jul 29, 2025Updated 7 months ago
- Distributed Compiler based on Triton for Parallel Systems☆1,380Feb 13, 2026Updated 3 weeks ago
- User-friendly implementation of the Mixture-of-Sparse-Attention (MoSA). MoSA selects distinct tokens for each head with expert choice rou…☆28May 3, 2025Updated 10 months ago
- ☆585Sep 23, 2025Updated 5 months ago
- Linear Attention Sequence Parallelism (LASP)☆89Jun 4, 2024Updated last year
- [NeurIPS 2025 Spotlight] TPA: Tensor ProducT ATTenTion Transformer (T6) (https://arxiv.org/abs/2501.06425)☆447Jan 26, 2026Updated last month
- [ICCV 2025] Dynamic-VLM☆28Dec 16, 2024Updated last year
- TransMLA: Multi-Head Latent Attention Is All You Need (NeurIPS 2025 Spotlight)☆432Feb 28, 2026Updated last week
- Code for Draft Attention☆99May 22, 2025Updated 9 months ago
- DeeperGEMM: crazy optimized version☆74May 5, 2025Updated 10 months ago