Alternatives and similar repositories for dynamic-sparsity

Users that are interested in dynamic-sparsity are comparing it to the libraries listed below

• abdelfattah-lab / shadow_llm
  ☆10Updated last year
• spcl / sten
  Sparsity support for PyTorch
  ☆37Updated 7 months ago
• VITA-Group / Q-Hitter
  ☆15Updated last year
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆41Updated last year
• PingchengDong / GQA-LUT
  The official implementation of the DAC 2024 paper GQA-LUT
  ☆20Updated 10 months ago
• merrymercy / Awesome-Efficient-LLM
  A curated list for Efficient Large Language Models
  ☆11Updated last year
• cornell-zhang / llm-datatypes
  Codebase for ICML'24 paper: Learning from Students: Applying t-Distributions to Explore Accurate and Efficient Formats for LLMs
  ☆27Updated last year
• apuaaChen / EVT_AE
  Artifacts of EVT ASPLOS'24
  ☆28Updated last year
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆48Updated 3 months ago
• parsa-epfl / HBFPEmulator
  ColTraIn HBFP Training Emulator
  ☆16Updated 2 years ago
• xxyux / SpInfer
  SpInfer: Leveraging Low-Level Sparsity for Efficient Large Language Model Inference on GPUs
  ☆59Updated 7 months ago
• uwsampl / SparseTIR
  SparseTIR: Sparse Tensor Compiler for Deep Learning
  ☆138Updated 2 years ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆100Updated 4 months ago
• microsoft / SparTA
  ☆158Updated last year
• ParCIS / FlashSparse
  FlashSparse significantly reduces the computation redundancy for unstructured sparsity (for SpMM and SDDMM) on Tensor Cores through a Swa…
  ☆32Updated last month
• brightlaboratory / polydl
  ☆11Updated 4 years ago
• YashasSamaga / ConvolutionBuildingBlocks
  GEMM and Winograd based convolutions using CUTLASS
  ☆28Updated 5 years ago
• spcl / substation
  Research and development for optimizing transformers
  ☆131Updated 4 years ago
• exists-forall / striped_attention
  ☆41Updated last year
• SeoLabCornell / torch2chip
  Torch2Chip (MLSys, 2024)
  ☆54Updated 7 months ago
• tonyzhang617 / nomad-dist
  ☆39Updated last year
• INT-FlashAttention2024 / INT-FlashAttention
  ☆83Updated 9 months ago
• HanGuo97 / hilt
  ☆35Updated this week
• sfox14 / block_minifloat
  Training with Block Minifloat number representation
  ☆16Updated 4 years ago
• sIncerass / QBERT
  ☆15Updated 3 years ago
• ranggihwang / Pregated_MoE
  ☆55Updated last year
• awslabs / ratex
  ☆23Updated 2 months ago
• UDC-GAC / venom
  A Vectorized N:M Format for Unleashing the Power of Sparse Tensor Cores
  ☆54Updated last year
• wimh966 / outlier_suppression
  The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…
  ☆48Updated 3 years ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆39Updated last year