XunhaoLai / native-sparse-attention-tritonLinks
Efficient triton implementation of Native Sparse Attention.
β168Updated last month
Alternatives and similar repositories for native-sparse-attention-triton
Users that are interested in native-sparse-attention-triton are comparing it to the libraries listed below
Sorting:
- π₯ A minimal training framework for scaling FLA modelsβ170Updated last week
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inferenceβ113Updated last month
- β114Updated 3 weeks ago
- SeerAttention: Learning Intrinsic Sparse Attention in Your LLMsβ126Updated last week
- [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Trainingβ209Updated last week
- XAttention: Block Sparse Attention with Antidiagonal Scoringβ166Updated this week
- Official implementation of "Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding"β233Updated 2 weeks ago
- Triton implementation of FlashAttention2 that adds Custom Masks.β120Updated 10 months ago
- The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>β134Updated 3 weeks ago
- Flash-Muon: An Efficient Implementation of Muon Optimizerβ131Updated last week
- A sparse attention kernel supporting mix sparse patternsβ238Updated 4 months ago
- β130Updated 4 months ago
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.β81Updated 6 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMsβ176Updated this week
- β104Updated 2 weeks ago
- β76Updated 3 months ago
- VeOmni: Scaling any Modality Model Training to any Accelerators with PyTorch native Training Frameworkβ353Updated last month
- GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLMβ163Updated 11 months ago
- β256Updated last year
- Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)β106Updated 3 months ago
- β208Updated 2 weeks ago
- [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inferenceβ295Updated 7 months ago
- β85Updated 2 months ago
- Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Trainingβ210Updated 10 months ago
- β45Updated last year
- 16-fold memory access reduction with nearly no lossβ99Updated 2 months ago
- Triton-based implementation of Sparse Mixture of Experts.β219Updated 6 months ago
- [ICML 2025] Fourier Position Embedding: Enhancing Attentionβs Periodic Extension for Length Generalizationβ71Updated 3 weeks ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decodingβ116Updated 6 months ago
- Odysseus: Playground of LLM Sequence Parallelismβ70Updated last year