Alternatives and similar repositories for Qwen-Native-Sparse-Attention

Users that are interested in Qwen-Native-Sparse-Attention are comparing it to the libraries listed below

• mdy666 / Scalable-Flash-Native-Sparse-Attention

  View on GitHub
  ☆48Dec 13, 2025Updated 2 months ago
• fla-org / native-sparse-attention

  View on GitHub
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆965Feb 5, 2026Updated last week
• ACA-Lab-SJTU / token-ring

  View on GitHub
  ☆13Jan 7, 2025Updated last year
• SqueezeAILab / SqueezedAttention

  View on GitHub
  [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference
  ☆56Nov 20, 2024Updated last year
• attention-survey / Efficient_Attention_Survey

  View on GitHub
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆281Dec 1, 2025Updated 2 months ago
• dhcode-cpp / NSA-pytorch

  View on GitHub
  DeepSeek Native Sparse Attention pytorch implementation
  ☆114Dec 17, 2025Updated last month
• Doraemonzzz / xmixers

  View on GitHub
  Xmixers: A collection of SOTA efficient token/channel mixers
  ☆28Sep 4, 2025Updated 5 months ago
• nil0x9 / flash-muon

  View on GitHub
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆235Jun 15, 2025Updated 8 months ago
• ademeure / DeeperGEMM

  View on GitHub
  DeeperGEMM: crazy optimized version
  ☆74May 5, 2025Updated 9 months ago
• mit-han-lab / Block-Sparse-Attention

  View on GitHub
  A sparse attention kernel supporting mix sparse patterns
  ☆455Jan 18, 2026Updated 3 weeks ago
• mit-han-lab / flash-moba

  View on GitHub
  ☆221Nov 19, 2025Updated 2 months ago
• rasbt / try-lion-optimizer

  View on GitHub
  ☆14Mar 9, 2023Updated 2 years ago
• AMDResearch / intelliperf

  View on GitHub
  Automated bottleneck detection and solution orchestration
  ☆19Updated this week
• UNITES-Lab / MoE-Quantization

  View on GitHub
  Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"
  ☆29Jun 30, 2025Updated 7 months ago
• hao-ai-lab / cse234-w25

  View on GitHub
  Website for CSE 234, Winter 2025
  ☆13Mar 24, 2025Updated 10 months ago
• HydraQYH / expert_specialization_moe

  View on GitHub
  Expert Specialization MoE Solution based on CUTLASS
  ☆27Jan 19, 2026Updated 3 weeks ago
• BUAADreamer / llmkiller

  View on GitHub
  LLM手撕代码合集
  ☆19Mar 25, 2025Updated 10 months ago
• HydraQYH / hp_rms_norm

  View on GitHub
  High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)
  ☆26Jan 22, 2026Updated 3 weeks ago
• Aaronhuang-778 / Mixture-Compressor-MoE

  View on GitHub
  [ICLR 2025] Mixture Compressor for Mixture-of-Experts LLMs Gains More
  ☆66Feb 12, 2025Updated last year
• tile-ai / AttentionEngine

  View on GitHub
  ☆52May 19, 2025Updated 8 months ago
• tilde-research / nsa-impl

  View on GitHub
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆129Jun 24, 2025Updated 7 months ago
• mit-han-lab / x-attention

  View on GitHub
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆269Jul 6, 2025Updated 7 months ago
• aws-neuron / nki-library

  View on GitHub
  ☆42Jan 24, 2026Updated 3 weeks ago
• xxyux / SpInfer

  View on GitHub
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆61Mar 25, 2025Updated 10 months ago
• Owen718 / LongPrompt-LLamaGen

  View on GitHub
  This repository provides an improved LLamaGen Model, fine-tuned on 500,000 high-quality images, each accompanied by over 300 token prompt…
  ☆30Oct 21, 2024Updated last year
• princeton-pli / LongProc

  View on GitHub
  LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
  ☆33Oct 11, 2025Updated 4 months ago
• luliyucoordinate / cute-flash-attention

  View on GitHub
  Implement Flash Attention using Cute.
  ☆100Dec 17, 2024Updated last year
• sustcsonglin / linear-attention-and-beyond-slides

  View on GitHub
  ☆106Feb 25, 2025Updated 11 months ago
• ByteDance-Seed / FlexPrefill

  View on GitHub
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆160Oct 13, 2025Updated 4 months ago
• sgl-project / DeepGEMM

  View on GitHub
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
  ☆22Feb 9, 2026Updated last week
• microsoft / AttentionEngine

  View on GitHub
  ☆118May 19, 2025Updated 8 months ago
• hazan-lab / flash-stu

  View on GitHub
  PyTorch implementation of the Flash Spectral Transform Unit.
  ☆21Sep 19, 2024Updated last year
• iree-org / wave

  View on GitHub
  Wave: Python Domain-Specific Language for High Performance Machine Learning
  ☆44Updated this week
• rlite-project / RLite

  View on GitHub
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆101Aug 25, 2025Updated 5 months ago
• sgl-project / genai-bench

  View on GitHub
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆266Updated this week
• lemyx / tilelang-dsa

  View on GitHub
  DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang
  ☆43Nov 19, 2025Updated 2 months ago
• Dao-AILab / gemm-cublas

  View on GitHub
  ☆22May 5, 2025Updated 9 months ago
• Infini-AI-Lab / vortex_torch

  View on GitHub
  Vortex: A Flexible and Efficient Sparse Attention Framework
  ☆46Jan 21, 2026Updated 3 weeks ago
• shawnricecake / search-llm

  View on GitHub
  [NeurIPS 2024] Search for Efficient LLMs
  ☆16Jan 16, 2025Updated last year