Sparse Decoupled Attention for Efficient Long-Context LLM Inference
☆74Jun 4, 2026Updated 5 months ago
Alternatives and similar repositories for SparDA
Users that are interested in SparDA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19May 27, 2026Updated 5 months ago
- ☆27Jul 13, 2026Updated 3 months ago
- The official implementation of NOSA (EMNLP 2026 main)☆19Sep 28, 2026Updated last month
- ☆14Oct 3, 2024Updated 2 years ago
- Official code for HiLS-Attention☆153Aug 13, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference☆172Oct 13, 2025Updated last year
- Official Implementation of APB (ACL 2025 main Oral) and Spava (ACL 2026 main).☆37Apr 6, 2026Updated 7 months ago
- [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring☆288Jul 6, 2025Updated last year
- DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention☆25May 25, 2026Updated 5 months ago
- [ICML 2026] Prism: Spectral-Aware Block-Sparse Attention☆27May 22, 2026Updated 5 months ago
- ☆255Nov 19, 2025Updated 11 months ago
- [ICLR 2025] DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads☆545Feb 10, 2025Updated last year
- [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference☆316May 1, 2025Updated last year
- [NeurIPS 2026] Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers☆48Jul 1, 2026Updated 4 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Learnable Semi-structured Sparsity for Vision Transformers and Diffusion Transformers☆16Feb 7, 2025Updated last year
- [CVPR 2026 Findings] V-GRPO: Online Reinforcement Learning for Denoising Generative Models Is Easier than You Think☆56Apr 28, 2026Updated 6 months ago
- Repo for ECHO: Efficient KV Cache Offloading with Lossless Prefetching for Serving Native Sparse Attention LLMs (OSDI'26)☆43Jul 12, 2026Updated 3 months ago
- [CVPRW 2026 Oral] Less Detail, Better Answers: Degradation-Driven Prompting for VQA☆19Apr 25, 2026Updated 6 months ago
- Implementation of Active Flow Expansion (ActFlow), preprint: https://arxiv.org/abs/2606.08802☆26Jun 27, 2026Updated 4 months ago
- [COLM 2025] Official code for "When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoni…☆15Oct 31, 2025Updated last year
- The evaluation framework for training-free sparse attention in LLMs☆134Jan 27, 2026Updated 9 months ago
- [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation☆256Dec 16, 2024Updated last year
- SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs☆224Jul 10, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICML 2026] Stable Asynchrony: Variance-Controlled Off-Policy RL for LLMs☆38Apr 27, 2026Updated 6 months ago
- Official repository for "SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space"☆32May 7, 2026Updated 6 months ago
- LUCID: Attention with Preconditioned Representations - A novel attention mechanism for improved long-context retrieval in Transformers☆13May 29, 2026Updated 5 months ago
- An abandoned game dev toolset.☆10Sep 18, 2021Updated 5 years ago
- Use Jev with Kimi K3 for hard classification☆17Sep 20, 2026Updated last month
- Code for the paper ReplaySSM: Cache SSM Inputs, Not State☆74Oct 13, 2026Updated 3 weeks ago
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.☆25May 20, 2026Updated 5 months ago
- Bayes@N [ICLR'26], Ranking LLMs [ACL'26 Main]: Statistical evaluation, comparison, and ranking of Large Language Models☆24Oct 20, 2026Updated 3 weeks ago
- ☆27Jul 22, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ThinK: Thinner Key Cache by Query-Driven Pruning☆30Jun 2, 2026Updated 5 months ago
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆16Mar 28, 2026Updated 7 months ago
- Fable 5 methodology as a Claude Code plugin: decompose by verification boundaries, verify against the world, choose next by plan-change. …☆13Jul 6, 2026Updated 4 months ago
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 5 months ago
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 7 months ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆122Dec 2, 2025Updated 11 months ago
- ☆14Jun 7, 2026Updated 5 months ago
Are these results useful?