mdy666/Qwen-Native-Sparse-Attention external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

mdy666/Qwen-Native-Sparse-Attention

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/mdy666/Qwen-Native-Sparse-Attention)

Close

mdy666 / Qwen-Native-Sparse-AttentionView on GitHubMore

• External links
• Readme badge

qwen-nsa

☆87Oct 14, 2025Updated 4 months ago

Alternatives and similar repositories for Qwen-Native-Sparse-Attention

Users that are interested in Qwen-Native-Sparse-Attention are comparing it to the libraries listed below

• mdy666 / Scalable-Flash-Native-Sparse-Attention

  View on GitHub
  ☆48Dec 13, 2025Updated 2 months ago
• fla-org / native-sparse-attention

  View on GitHub
  🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"
  ☆974Feb 5, 2026Updated last month
• ACA-Lab-SJTU / token-ring

  View on GitHub
  ☆13Jan 7, 2025Updated last year
• XunhaoLai / native-sparse-attention-triton

  View on GitHub
  Efficient triton implementation of Native Sparse Attention.
  ☆269May 23, 2025Updated 9 months ago
• SqueezeAILab / SqueezedAttention

  View on GitHub
  [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference
  ☆57Nov 20, 2024Updated last year
• HydraQYH / hp_rms_norm

  View on GitHub
  High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)
  ☆30Jan 22, 2026Updated last month
• attention-survey / Efficient_Attention_Survey

  View on GitHub
  A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention
  ☆284Dec 1, 2025Updated 3 months ago
• dhcode-cpp / NSA-pytorch

  View on GitHub
  DeepSeek Native Sparse Attention pytorch implementation
  ☆114Dec 17, 2025Updated 2 months ago
• Doraemonzzz / xmixers

  View on GitHub
  Xmixers: A collection of SOTA efficient token/channel mixers
  ☆28Sep 4, 2025Updated 6 months ago
• nil0x9 / flash-muon

  View on GitHub
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆239Jun 15, 2025Updated 8 months ago
• ademeure / DeeperGEMM

  View on GitHub
  DeeperGEMM: crazy optimized version
  ☆74May 5, 2025Updated 10 months ago
• mit-han-lab / Block-Sparse-Attention

  View on GitHub
  A sparse attention kernel supporting mix sparse patterns
  ☆472Jan 18, 2026Updated last month
• mit-han-lab / flash-moba

  View on GitHub
  ☆227Nov 19, 2025Updated 3 months ago
• AMDResearch / intelliperf

  View on GitHub
  Automated bottleneck detection and solution orchestration
  ☆19Feb 24, 2026Updated last week
• UNITES-Lab / MoE-Quantization

  View on GitHub
  Official code for the paper "Examining Post-Training Quantization for Mixture-of-Experts: A Benchmark"
  ☆30Jun 30, 2025Updated 8 months ago
• microsoft / SeerAttention

  View on GitHub
  SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
  ☆194Sep 23, 2025Updated 5 months ago
• HydraQYH / expert_specialization_moe

  View on GitHub
  Expert Specialization MoE Solution based on CUTLASS
  ☆27Jan 19, 2026Updated last month
• hao-ai-lab / cse234-w25

  View on GitHub
  Website for CSE 234, Winter 2025
  ☆13Mar 24, 2025Updated 11 months ago
• tile-ai / AttentionEngine

  View on GitHub
  ☆52May 19, 2025Updated 9 months ago
• tilde-research / nsa-impl

  View on GitHub
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆129Jun 24, 2025Updated 8 months ago
• mit-han-lab / x-attention

  View on GitHub
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆269Jul 6, 2025Updated 8 months ago
• Aaronhuang-778 / Mixture-Compressor-MoE

  View on GitHub
  [ICLR 2025, IEEE TPAMI 2026] Mixture Compressor & MC#
  ☆68Feb 12, 2025Updated last year
• Owen718 / LongPrompt-LLamaGen

  View on GitHub
  This repository provides an improved LLamaGen Model, fine-tuned on 500,000 high-quality images, each accompanied by over 300 token prompt…
  ☆30Oct 21, 2024Updated last year
• xxyux / SpInfer

  View on GitHub
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆60Mar 25, 2025Updated 11 months ago
• princeton-pli / LongProc

  View on GitHub
  LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
  ☆33Feb 26, 2026Updated last week
• luliyucoordinate / cute-flash-attention

  View on GitHub
  Implement Flash Attention using Cute.
  ☆102Dec 17, 2024Updated last year
• sustcsonglin / linear-attention-and-beyond-slides

  View on GitHub
  ☆107Feb 25, 2025Updated last year
• THUDM / CogKit

  View on GitHub
  Finetuning and inference tools for the CogView4 and CogVideoX model series.
  ☆118May 14, 2025Updated 9 months ago
• BUAADreamer / llmkiller

  View on GitHub
  LLM手撕代码合集
  ☆20Mar 25, 2025Updated 11 months ago
• sgl-project / DeepGEMM

  View on GitHub
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
  ☆21Feb 9, 2026Updated last month
• TiledTensor / TiledBench

  View on GitHub
  Benchmark tests supporting the TiledCUDA library.
  ☆18Nov 19, 2024Updated last year
• ByteDance-Seed / FlexPrefill

  View on GitHub
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆161Oct 13, 2025Updated 4 months ago
• microsoft / AttentionEngine

  View on GitHub
  ☆118May 19, 2025Updated 9 months ago
• ByteDance-Seed / ShadowKV

  View on GitHub
  [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
  ☆283May 1, 2025Updated 10 months ago
• hazan-lab / flash-stu

  View on GitHub
  PyTorch implementation of the Flash Spectral Transform Unit.
  ☆22Sep 19, 2024Updated last year
• rlite-project / RLite

  View on GitHub
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆102Aug 25, 2025Updated 6 months ago
• sgl-project / genai-bench

  View on GitHub
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆275Updated this week
• iree-org / wave

  View on GitHub
  Wave: Python Domain-Specific Language for High Performance Machine Learning
  ☆45Updated this week
• Infini-AI-Lab / vortex_torch

  View on GitHub
  Vortex: A Flexible and Efficient Sparse Attention Framework
  ☆48Jan 21, 2026Updated last month