Alternatives and similar repositories for sparselora

Users that are interested in sparselora are comparing it to the libraries listed below

• mit-han-lab / x-attention
  [ICML 2025] XAttention: Block Sparse Attention with Antidiagonal Scoring
  ☆219Updated last month
• attention-survey / Efficient_Attention_Survey
  Efficient Attention Methods: A Comprehensive Survey
  ☆75Updated this week
• IST-DASLab / HALO
  HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…
  ☆20Updated 6 months ago
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆104Updated 5 months ago
• tilde-research / nsa-impl
  An efficient implementation of the NSA (Native Sparse Attention) kernel
  ☆113Updated 2 months ago
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆280Updated 6 months ago
• Dao-AILab / grouped-latent-attention
  ☆123Updated 2 months ago
• thu-nics / MoA
  [CoLM'25] The official implementation of the paper <MoA: Mixture of Sparse Attention for Automatic Large Language Model Compression>
  ☆145Updated last month
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆133Updated 3 months ago
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆43Updated last month
• machilusZ / FastGen
  This repo contains the source code for: Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
  ☆39Updated last year
• FasterDecoding / TEAL
  ☆139Updated 6 months ago
• zyxxmu / cam
  Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference
  ☆42Updated last year
• xdit-project / DiTCacheAnalysis
  An auxiliary project analysis of the characteristics of KV in DiT Attention.
  ☆32Updated 8 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆44Updated 9 months ago
• horseee / dKV-Cache
  ☆90Updated 3 months ago
• NVlabs / COAT
  [ICLR 2025] COAT: Compressing Optimizer States and Activation for Memory-Efficient FP8 Training
  ☆231Updated 2 weeks ago
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆75Updated 10 months ago
• OpenSparseLLMs / Linearization
  ☆55Updated last month
• SqueezeAILab / SqueezedAttention
  SQUEEZED ATTENTION: Accelerating Long Prompt LLM Inference
  ☆51Updated 9 months ago
• Aaronhuang-778 / SliM-LLM
  [ICML 2025] SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆40Updated last year
• Aaronhuang-778 / Mixture-Compressor-MoE
  [ICLR 2025] Mixture Compressor for Mixture-of-Experts LLMs Gains More
  ☆50Updated 6 months ago
• ruikangliu / Quantized-Reasoning-Models
  [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"
  ☆44Updated last month
• mit-han-lab / VisCompare
  A WebUI for Side-by-Side Comparison of Media (Images/Videos) Across Multiple Folders
  ☆23Updated 6 months ago
• NoakLiu / FastCache-xDiT
  FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]
  ☆32Updated last week
• Qualcomm-AI-research / lr-qat
  ☆43Updated 9 months ago
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆67Updated last year
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆47Updated last year
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆92Updated 7 months ago
• yuezhouhu / 2by4-pretrain
  Efficient 2:4 sparse training algorithms and implementations
  ☆55Updated 8 months ago